-- Logs begin at Sun 2022-07-31 17:56:16 UTC, end at Sun 2022-07-31 18:54:10 UTC. -- Jul 31 18:23:01.954302 dv-cinder-849846-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 31 18:23:01.963006 dv-cinder-849846-5-smb devstack@keystone.service[80125]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 18:23:01 2022] *** Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: nodename: dv-cinder-849846-5-smb Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: machine: x86_64 Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: clock source: unix Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: pcre jit disabled Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: detected number of CPU cores: 4 Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: current working directory: / Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: detected binary path: /usr/bin/uwsgi-core Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: your processes number limit is 47680 Jul 31 18:23:01.965120 dv-cinder-849846-5-smb devstack@keystone.service[80125]: your memory page size is 4096 bytes Jul 31 18:23:01.966474 dv-cinder-849846-5-smb devstack@keystone.service[80125]: detected max file descriptor number: 2048 Jul 31 18:23:01.966474 dv-cinder-849846-5-smb devstack@keystone.service[80125]: lock engine: pthread robust mutexes Jul 31 18:23:01.966474 dv-cinder-849846-5-smb devstack@keystone.service[80125]: thunder lock: enabled Jul 31 18:23:01.966474 dv-cinder-849846-5-smb devstack@keystone.service[80125]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 31 18:23:01.966474 dv-cinder-849846-5-smb devstack@keystone.service[80125]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 18:23:02.005627 dv-cinder-849846-5-smb devstack@keystone.service[80125]: Python main interpreter initialized at 0x558b7eb7f9c0 Jul 31 18:23:02.005627 dv-cinder-849846-5-smb devstack@keystone.service[80125]: python threads support enabled Jul 31 18:23:02.005627 dv-cinder-849846-5-smb devstack@keystone.service[80125]: your server socket listen backlog is limited to 100 connections Jul 31 18:23:02.005627 dv-cinder-849846-5-smb devstack@keystone.service[80125]: your mercy for graceful operations on workers is 90 seconds Jul 31 18:23:02.006018 dv-cinder-849846-5-smb devstack@keystone.service[80125]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 18:23:02.006097 dv-cinder-849846-5-smb devstack@keystone.service[80125]: *** Operational MODE: preforking *** Jul 31 18:23:02.006317 dv-cinder-849846-5-smb devstack@keystone.service[80125]: *** uWSGI is running in multiple interpreter mode *** Jul 31 18:23:02.006317 dv-cinder-849846-5-smb devstack@keystone.service[80125]: spawned uWSGI master process (pid: 80125) Jul 31 18:23:02.006518 dv-cinder-849846-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 31 18:23:02.010779 dv-cinder-849846-5-smb devstack@keystone.service[80125]: spawned uWSGI worker 1 (pid: 80135, cores: 1) Jul 31 18:23:02.010779 dv-cinder-849846-5-smb devstack@keystone.service[80125]: spawned uWSGI worker 2 (pid: 80136, cores: 1) Jul 31 18:23:02.010779 dv-cinder-849846-5-smb devstack@keystone.service[80125]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 18:23:07.503949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:23:07.503949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jul 31 18:23:07.504728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:23:07.504728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jul 31 18:23:07.513585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:23:07.513585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: from cryptography.utils import int_from_bytes Jul 31 18:23:07.514099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:23:07.514099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: from cryptography.utils import int_from_bytes Jul 31 18:23:07.556252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 18:23:07.556446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 18:23:07.556637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] command line args: [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 18:23:07.556910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 18:23:07.557089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ================================================================================ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 18:23:07.557340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.557580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_dir = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.557763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.557940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_source = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.558116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] debug = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.558312 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.558796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.558892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.559109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.559357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.559648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.559834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_config_append = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.559980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.560141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_dir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.560302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.560984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.561336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.561586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.561834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.562010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.562186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.562429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.562671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.562903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.563164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.563253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 18:23:07.563397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.563476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 18:23:07.563606 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] command line args: [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 18:23:07.563692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.563861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.563938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 18:23:07.564077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ================================================================================ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 18:23:07.564272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.564474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] admin_token = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.564665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.564843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] config_dir = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.564843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.565133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.565299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] config_source = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.565433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] publish_errors = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.565559 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] debug = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.565710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.565844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.566008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.566162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.566296 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.566453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.566587 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.566713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.566846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] standard_threads = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] log_config_append = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] log_dir = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] log_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_journal = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_json = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.567971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_stderr = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_syslog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.568653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.568806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.568885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.568967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.569063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.569139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.569227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.569307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.569380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.569457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.569457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.569594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.569733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.569815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.569888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.569966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.570039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.570111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.570252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.570339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.570498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.570727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.570806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.570913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] publish_errors = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.571011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.571169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.571257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.571407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.571488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.571611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.571687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.571819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.571899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.572054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.572134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.572288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] standard_threads = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.572367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.572519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.572600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.572762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.572843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.572941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.573071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.573151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] use_journal = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.573277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] use_json = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.573366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.573441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] use_stderr = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.573555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.573634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] use_syslog = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.573785 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.573864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:23:07.574014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.574094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.574241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.574320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.574474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.574554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.574704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.574815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.575950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.576902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.577995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.578949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.579988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.580898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.581993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.582950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.583971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.584891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.585917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.586994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.587118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.587236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.587358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.587476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.587610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.587775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.587898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.588944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.589894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.590012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.590128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.590251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.590378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.591932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.592986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.external = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.593993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.594144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.password = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.594262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.594386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.token = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.594513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.594640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.594768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.594886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.595904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.596978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.597965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.598957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.599936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.external = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.600891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.password = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] auth.token = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.601974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.602102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.602228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.602347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.602465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.602583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.602716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.602838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.603963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.604925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.605881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.606972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.607999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.608955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.609912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.610875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.611953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.612918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.613984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.614962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.615922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.616994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.617952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.618987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.619954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.620903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.621020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.621137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.621262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.621381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.621499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.621616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.622229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.622347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.622472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.622593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.622766 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.622911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.623899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.624958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.625893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.626854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.627834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628296 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.628890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.629965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.630999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.631959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.632918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633865 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.633991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.634824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] role.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] role.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.635955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.636913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.637031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.637149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.637855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.638273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.638405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.638534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.638806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.638955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.639918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.640148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.640267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.640385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.640509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.640638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.640766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.640885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.641949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.642899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.643989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.644939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.645891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.645891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.645891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.645891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.645891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.645891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.645891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.646630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.646630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.646630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.646994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.647127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.647366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.647609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.647847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.648085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.648322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.648560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.648806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.649043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.649287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.649522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.649770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.650007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.650253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.650488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.650731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.650990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:23:07.651161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 18:23:07.670915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.671165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.671396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.676210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.676445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.676672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.679715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.685960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.710414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.710640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.714538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.714774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.763947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.765111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.814405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.814632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.816095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.816332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.879787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.880942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.881077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.881294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.881508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.906172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.906432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.906566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.906670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.906753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.906830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.906907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.907052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.907153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.907266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.907352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.907478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.907563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.907691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.918436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.918910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.931134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.931360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.931547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.931651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.931781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.931875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932143 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.932824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80136) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 18:23:07.949312 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.949473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 18:23:07.949670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.950336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.950432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 18:23:07.950544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 18:23:07.950809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.950991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.951100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.951204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 18:23:07.951354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.951476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.951601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.951731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.951983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.952232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.961130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.961401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.961662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.961801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.961935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.962076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.962341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.962619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.969345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:07.970451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:07.973980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:07.974256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.974532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.974806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.975113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.975199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:07.975367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.975456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.975629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.975713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.975895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.975988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.976156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.976239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.976421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.976504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.976683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.976772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.976951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.977216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.977486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.977747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:07.999402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.000873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.001111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.001197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.002583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.002861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.005662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.005935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.006207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.007448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.007727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.008005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.013481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.013770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.015734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.016016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.017832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.018113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.018399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.018675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.018963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.019238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.019497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.019762 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.020262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.020548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.020831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.021121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.021390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.021666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.021944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.022215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.035681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.035955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.038419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.038697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.039813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.042580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.042904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.043224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.046545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.046840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.048158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.051214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.051308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.054339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.054423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.054657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.054964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.055258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.055538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.055822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.057496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.057789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.058069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.058360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.058634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.058945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.071796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.072073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.072334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.072591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.075422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.075727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.075999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.076262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.079434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.080976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.081247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.083160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.084035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.084310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.084600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.084681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.084886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.084971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.085171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.087740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.088016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.088311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.088598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.088874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.097175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.097450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.097726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.098000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.098273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.098541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.098811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.101166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.101447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.101724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.102000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.102274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.102543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.102812 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.114510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.117438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.118651 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.120343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.121585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.123445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.124930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.125209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.125404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.125489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.127866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.129337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.129637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.129942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.131852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.133449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.136337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.136421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.136620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.136895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.137162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.138560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.141490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.141779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.142071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.142342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.145411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.145693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.145968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.150265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.150552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.150834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.152697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.153550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.153825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.154106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.154381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.154654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.154927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.155218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.155583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.155863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.156140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.156398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.156666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.156920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.158461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80136) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 18:23:08.158737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.159040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.159312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.159587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.159856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.160132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.160392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.160756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.161032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.161308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.161573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.161841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.162095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80136) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 18:23:08.190203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b7eb7f9c0 pid: 80135 (default app) Jul 31 18:23:08.193463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde1eb-f55e-41c7-8df4-92fa734449b1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:08.193747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde1eb-f55e-41c7-8df4-92fa734449b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:08.194017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde1eb-f55e-41c7-8df4-92fa734449b1 None None] PATH_INFO: `/v3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:08.196458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b7eb7f9c0 pid: 80136 (default app) Jul 31 18:23:08.198289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Sun Jul 31 18:23:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:15.843324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b644-ee88-49c0-a2d4-73e342f8d453 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:15.843885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b644-ee88-49c0-a2d4-73e342f8d453 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:15.843885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b644-ee88-49c0-a2d4-73e342f8d453 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:15.848289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:15.853391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:15.853825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:15.853942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:15.926743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: INFO dbcounter [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] Registered counter for database keystone Jul 31 18:23:15.946230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG oslo_db.sqlalchemy.engines [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:23:15.953822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writer thread running {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:23:16.132791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80135) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 18:23:16.133123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80135) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 18:23:16.187749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:16.189340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:16.322171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 31 18:23:16.471767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b644-ee88-49c0-a2d4-73e342f8d453 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:16.543036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: INFO dbcounter [None req-b584b644-ee88-49c0-a2d4-73e342f8d453 None None] Registered counter for database keystone Jul 31 18:23:16.564370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG oslo_db.sqlalchemy.engines [None req-b584b644-ee88-49c0-a2d4-73e342f8d453 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:23:16.570438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writer thread running {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:23:16.689715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b644-ee88-49c0-a2d4-73e342f8d453 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:16.693924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa54a9-17b5-41b4-963f-3c5248c89ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:16.694578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa54a9-17b5-41b4-963f-3c5248c89ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:16.694862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa54a9-17b5-41b4-963f-3c5248c89ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:16.695167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa54a9-17b5-41b4-963f-3c5248c89ae4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:16.703840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa54a9-17b5-41b4-963f-3c5248c89ae4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:16.756467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10aa54a9-17b5-41b4-963f-3c5248c89ae4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 18:23:16.756814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa54a9-17b5-41b4-963f-3c5248c89ae4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:16.766765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Jul 31 18:23:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 18:23:16.772756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:16.787225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da806e7-3a36-427a-9df5-e205fa326b52 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:16.791696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e8097-fb4e-4dfd-8016-6f0af7c0f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:16.792808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e8097-fb4e-4dfd-8016-6f0af7c0f2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:16.793088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e8097-fb4e-4dfd-8016-6f0af7c0f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:16.793357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e8097-fb4e-4dfd-8016-6f0af7c0f2dc admin admin] PATH_INFO: `/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:16.795502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e8097-fb4e-4dfd-8016-6f0af7c0f2dc admin admin] RBAC: Authorizing `identity:get_project(project_id=d68ea2a81ace4d57afbbf4c3099ddcb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:16.847042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING keystone.common.rbac_enforcer.enforcer [None req-434e8097-fb4e-4dfd-8016-6f0af7c0f2dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 18:23:16.847385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e8097-fb4e-4dfd-8016-6f0af7c0f2dc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:16.852096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Sun Jul 31 18:23:16 2022] GET /identity/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:18.830355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d36f3-6a9a-4ec8-ba93-bd5ee872d61a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:18.830887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d36f3-6a9a-4ec8-ba93-bd5ee872d61a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:18.830887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d36f3-6a9a-4ec8-ba93-bd5ee872d61a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:18.835002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:18.840209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbfc6b-8b4d-4142-a81a-b4836694bae9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:18.841233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbfc6b-8b4d-4142-a81a-b4836694bae9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:18.841381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbfc6b-8b4d-4142-a81a-b4836694bae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:18.861366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9adbfc6b-8b4d-4142-a81a-b4836694bae9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:18.862887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9adbfc6b-8b4d-4142-a81a-b4836694bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:18.870692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 31 18:23:18.892014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d36f3-6a9a-4ec8-ba93-bd5ee872d61a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:18.905302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d36f3-6a9a-4ec8-ba93-bd5ee872d61a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:18.909473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299988-92a0-4308-a611-7826ae8cc849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:18.910078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299988-92a0-4308-a611-7826ae8cc849 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:18.910355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299988-92a0-4308-a611-7826ae8cc849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:18.910626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299988-92a0-4308-a611-7826ae8cc849 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:18.918204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299988-92a0-4308-a611-7826ae8cc849 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:18.920594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299988-92a0-4308-a611-7826ae8cc849 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:18.929201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Jul 31 18:23:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:23:18.934409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbfc6b-8b4d-4142-a81a-b4836694bae9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:18.943433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbfc6b-8b4d-4142-a81a-b4836694bae9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:18.947780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603a4f4-5e3d-4049-9d61-c1366372e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:18.948401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603a4f4-5e3d-4049-9d61-c1366372e1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:18.948681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603a4f4-5e3d-4049-9d61-c1366372e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:18.948954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603a4f4-5e3d-4049-9d61-c1366372e1e9 admin admin] PATH_INFO: `/v3/users/6d7a1be1b9784e5783ae48b795a00917` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:18.951076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603a4f4-5e3d-4049-9d61-c1366372e1e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=6d7a1be1b9784e5783ae48b795a00917)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:18.952894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603a4f4-5e3d-4049-9d61-c1366372e1e9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:18.954412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Sun Jul 31 18:23:18 2022] GET /identity/v3/users/6d7a1be1b9784e5783ae48b795a00917 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:21.002361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfb99-95aa-4f1a-88ec-b088a742acf8 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.002902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfb99-95aa-4f1a-88ec-b088a742acf8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.002902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfb99-95aa-4f1a-88ec-b088a742acf8 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.004278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:21.008280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6e51d-25f9-42cf-9244-e39eca27fbcf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.008705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6e51d-25f9-42cf-9244-e39eca27fbcf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.008912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6e51d-25f9-42cf-9244-e39eca27fbcf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.009609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623293b-52ac-4645-b593-eca334714e09 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.009888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623293b-52ac-4645-b593-eca334714e09 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.010159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623293b-52ac-4645-b593-eca334714e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.010264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:21.016189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89beb2-ddb2-411f-bb84-1c9fdd413459 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.016474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89beb2-ddb2-411f-bb84-1c9fdd413459 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.016750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89beb2-ddb2-411f-bb84-1c9fdd413459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.035675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8a89beb2-ddb2-411f-bb84-1c9fdd413459 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:21.036888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8a89beb2-ddb2-411f-bb84-1c9fdd413459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:21.052231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG passlib.handlers.bcrypt [None req-4623293b-52ac-4645-b593-eca334714e09 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80136) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 18:23:21.052656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG passlib.handlers.bcrypt [None req-4623293b-52ac-4645-b593-eca334714e09 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80136) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 18:23:21.098784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4623293b-52ac-4645-b593-eca334714e09 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:21.100377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4623293b-52ac-4645-b593-eca334714e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:21.115257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:21.137889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89beb2-ddb2-411f-bb84-1c9fdd413459 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.160783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:21.201619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:21.224084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623293b-52ac-4645-b593-eca334714e09 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.239968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89beb2-ddb2-411f-bb84-1c9fdd413459 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.273669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.274222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.274500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.274773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.321565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623293b-52ac-4645-b593-eca334714e09 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.323843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:21.341421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:21.342906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:21.359994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.361106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.361387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.361658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.365432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:21.374392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:21.382798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:21.383890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:21.384717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:23:21.390219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.444385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 18:23:21.449884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.488872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada949c7-8a6c-4543-8e73-10826ef157f8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.522420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.523070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.523353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.523628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.524399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:21.524648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:21.526095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:21.538607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:21.544220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.547677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7b0c-d582-4dfc-8ac6-374fc042b4a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.570768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:21.573915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:21.582843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.583525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.583802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.584072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.594615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:21.596121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:23:21.614016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:21.615138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:21.616143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:23:21.616143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:23:21.616143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:23:21.616143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:21.616143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:23:21.621018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.648049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63fd5-b866-4dff-8c44-d2b0c2374802 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.681906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.682548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.682826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.683126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] PATH_INFO: `/v3/users/6d7a1be1b9784e5783ae48b795a00917` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.684678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] RBAC: Authorizing `identity:get_user(user_id=6d7a1be1b9784e5783ae48b795a00917)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:21.686172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:21.687822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/users/6d7a1be1b9784e5783ae48b795a00917 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:21.693108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.792013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:21.799362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6828d5-d0c3-41a8-b821-6be6f51295d2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.829218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738bbf1-83b3-4785-993f-512e24697f20 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.834263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.835051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.835420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.835786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.837095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:21.838782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:21.841099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:21.846868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:21.862964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921c9a1-1dc3-45e6-95cf-335c59e60ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.863592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c9a1-1dc3-45e6-95cf-335c59e60ebc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.863870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c9a1-1dc3-45e6-95cf-335c59e60ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.864140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c9a1-1dc3-45e6-95cf-335c59e60ebc None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.864826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921c9a1-1dc3-45e6-95cf-335c59e60ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:21.865126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921c9a1-1dc3-45e6-95cf-335c59e60ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:21.866502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921c9a1-1dc3-45e6-95cf-335c59e60ebc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:21.883628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:21.956469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e205fd-a5c6-4a77-a5f7-19929c5a3ee9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:21.991221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3405441-fa64-43d1-a42a-484afc8de961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:21.991856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405441-fa64-43d1-a42a-484afc8de961 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:21.992133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405441-fa64-43d1-a42a-484afc8de961 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:21.992406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405441-fa64-43d1-a42a-484afc8de961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:21.993203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3405441-fa64-43d1-a42a-484afc8de961 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.domain.id=default, user.id=6d7a1be1b9784e5783ae48b795a00917) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:21.993509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3405441-fa64-43d1-a42a-484afc8de961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:21.995021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3405441-fa64-43d1-a42a-484afc8de961 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:22.004530 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Jul 31 18:23:21 2022] GET /identity/v3/role_assignments?user.id=6d7a1be1b9784e5783ae48b795a00917&scope.domain.id=default&role.id=2f18a54954a047398aca6b1a7389586b => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:24.376174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14221-bd7f-4ca5-84aa-4fc0a66c20bd None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.376710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14221-bd7f-4ca5-84aa-4fc0a66c20bd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.376710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14221-bd7f-4ca5-84aa-4fc0a66c20bd None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.378214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:24.389040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a183-e5dd-4b86-af7f-fcdd9c16673b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.389495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a183-e5dd-4b86-af7f-fcdd9c16673b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.389683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a183-e5dd-4b86-af7f-fcdd9c16673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.397701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d868-f11e-4092-94cb-3c425f8c0a71 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.397986 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d868-f11e-4092-94cb-3c425f8c0a71 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.398263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d868-f11e-4092-94cb-3c425f8c0a71 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.399736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:23:24.417457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-66f2a183-e5dd-4b86-af7f-fcdd9c16673b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:24.418717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-66f2a183-e5dd-4b86-af7f-fcdd9c16673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:24.422353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b064c-b59d-4379-b5b8-60f1f5b3d66c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.422639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b064c-b59d-4379-b5b8-60f1f5b3d66c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.422916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b064c-b59d-4379-b5b8-60f1f5b3d66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.452047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b01b064c-b59d-4379-b5b8-60f1f5b3d66c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:24.453259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b01b064c-b59d-4379-b5b8-60f1f5b3d66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:24.467353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:24.501428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:24.552300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:24.554011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7abe20-e091-4ff0-94f6-294dc03dff3d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.556223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7abe20-e091-4ff0-94f6-294dc03dff3d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.556733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7abe20-e091-4ff0-94f6-294dc03dff3d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.558221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 13/25] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:24.564201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1fe0c-92a3-4421-9eb0-a8203065040d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.564726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1fe0c-92a3-4421-9eb0-a8203065040d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.565217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1fe0c-92a3-4421-9eb0-a8203065040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.581073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:24.587328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b064c-b59d-4379-b5b8-60f1f5b3d66c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:24.601357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0bf1fe0c-92a3-4421-9eb0-a8203065040d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:24.602830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0bf1fe0c-92a3-4421-9eb0-a8203065040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:24.739809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:24.742570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1fe0c-92a3-4421-9eb0-a8203065040d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:24.785389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b064c-b59d-4379-b5b8-60f1f5b3d66c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:24.832712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:24.833687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.834171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.834644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.835611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:24.837240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:24.889597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:24.907746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1fe0c-92a3-4421-9eb0-a8203065040d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:24.992787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:24.993366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:24.993648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:24.993920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:24.999916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 14/28] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Jul 31 18:23:24 2022] POST /identity/v3/roles => generated 219 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:23:25.000895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:25.026272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:25.034375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:25.035341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:25.036544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:25.042570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:25.062754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:25.245840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2faf-c2ea-4398-8927-e46c0b36d458 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:25.304618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a5c1a-ac5c-4d08-83a7-d0bd759c243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:25.305294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5c1a-ac5c-4d08-83a7-d0bd759c243d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.305579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5c1a-ac5c-4d08-83a7-d0bd759c243d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.306099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5c1a-ac5c-4d08-83a7-d0bd759c243d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.326140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a5c1a-ac5c-4d08-83a7-d0bd759c243d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:25.328251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a5c1a-ac5c-4d08-83a7-d0bd759c243d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-204a5c1a-ac5c-4d08-83a7-d0bd759c243d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:23:25.357491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:25.358376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:25.359241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:23:25.359241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:23:25.359241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:23:25.359241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:25.363417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:25.363417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d9798-3920-4e0c-82b8-e94cc9ed3705 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.363417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d9798-3920-4e0c-82b8-e94cc9ed3705 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.363992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d9798-3920-4e0c-82b8-e94cc9ed3705 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.365539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:25.373703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c062a-6a20-4f70-8f8c-79cc9b77114e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.373703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c062a-6a20-4f70-8f8c-79cc9b77114e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.373703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c062a-6a20-4f70-8f8c-79cc9b77114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.394544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31835-7203-4d0c-9b15-586f6d91851d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:25.404448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-120c062a-6a20-4f70-8f8c-79cc9b77114e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:25.406027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-120c062a-6a20-4f70-8f8c-79cc9b77114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:25.450060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:25.450692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.450995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.451268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.451999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:25.452298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:25.454906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:25.475344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:25.475344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:25.487323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:25.496607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:25.498141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18683d6-7150-40a4-aacd-f7a8d9e48b72 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.498428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18683d6-7150-40a4-aacd-f7a8d9e48b72 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.498705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18683d6-7150-40a4-aacd-f7a8d9e48b72 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.504448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 18/34] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:25.505370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18683d6-7150-40a4-aacd-f7a8d9e48b72 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:25.519638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:25.603709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714adec-e51d-4928-bee8-8cb9c2e95735 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:25.647004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18683d6-7150-40a4-aacd-f7a8d9e48b72 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:25.667913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:25.668587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.668870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.669147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.669862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:25.670169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:25.672263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:25.690998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32381fa-7e71-4f28-bdaa-4737a5c636e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:25.691664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32381fa-7e71-4f28-bdaa-4737a5c636e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.691960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32381fa-7e71-4f28-bdaa-4737a5c636e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.692973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32381fa-7e71-4f28-bdaa-4737a5c636e9 None admin] PATH_INFO: `/v3/users/6d7a1be1b9784e5783ae48b795a00917` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.693413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32381fa-7e71-4f28-bdaa-4737a5c636e9 None admin] RBAC: Authorizing `identity:get_user(user_id=6d7a1be1b9784e5783ae48b795a00917)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:25.694880 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32381fa-7e71-4f28-bdaa-4737a5c636e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:25.697655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 19/35] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:25 2022] GET /identity/v3/users/6d7a1be1b9784e5783ae48b795a00917 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:25.702978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b940d64-da2f-41c6-ad9d-7c16ad0644cd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.702978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b940d64-da2f-41c6-ad9d-7c16ad0644cd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.702978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b940d64-da2f-41c6-ad9d-7c16ad0644cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.707555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 17/36] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:25.708400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:25.727361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b940d64-da2f-41c6-ad9d-7c16ad0644cd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:25.729157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b940d64-da2f-41c6-ad9d-7c16ad0644cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:25.797261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:25.825846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 20/37] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:25.827634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b940d64-da2f-41c6-ad9d-7c16ad0644cd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:25.836124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88d27-807c-48b8-adf5-3dded47c82f0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:25.836875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:25.876899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:25.877859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.878283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.878699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.879619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:25.881435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:25.948706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b940d64-da2f-41c6-ad9d-7c16ad0644cd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:25.985892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:25.986575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:25.986856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:25.987162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:25.988316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:25.989883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:25.991925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 21/38] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:25.992498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:26.055048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 18/39] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Jul 31 18:23:25 2022] POST /identity/v3/roles => generated 225 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:26.055048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:26.077013 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:26.114608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc825-affe-427b-9012-45d113ed831a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:26.156371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e7d7d-9b7e-482b-bf89-7741c962a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:26.157009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e7d7d-9b7e-482b-bf89-7741c962a37c None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:26.157288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e7d7d-9b7e-482b-bf89-7741c962a37c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:26.157560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e7d7d-9b7e-482b-bf89-7741c962a37c None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:26.158248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e7d7d-9b7e-482b-bf89-7741c962a37c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:26.159766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e7d7d-9b7e-482b-bf89-7741c962a37c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:26.169457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbba05-661d-4009-988d-96cb12fc25f2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:26.193520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 22/40] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:23:25 2022] POST /identity/v3/projects => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:26.195141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2bba0-ae56-4b51-b286-6d056ef69a2b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:26.195488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2bba0-ae56-4b51-b286-6d056ef69a2b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:26.195842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2bba0-ae56-4b51-b286-6d056ef69a2b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:26.197651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 23/41] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:26.203508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2bba0-ae56-4b51-b286-6d056ef69a2b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:26.208295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:26.223425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d77b-d499-414b-95fe-70dcf43b37f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:26.224094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d77b-d499-414b-95fe-70dcf43b37f4 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:26.224381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d77b-d499-414b-95fe-70dcf43b37f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:26.224662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d77b-d499-414b-95fe-70dcf43b37f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:26.225422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d77b-d499-414b-95fe-70dcf43b37f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:26.227163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d77b-d499-414b-95fe-70dcf43b37f4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:26.250449 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 19/42] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Jul 31 18:23:26 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:26.251752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd83b9-6e7d-437f-b9ff-9d0e6248f348 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:26.252056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd83b9-6e7d-437f-b9ff-9d0e6248f348 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:26.252320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd83b9-6e7d-437f-b9ff-9d0e6248f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:26.285205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-79dd83b9-6e7d-437f-b9ff-9d0e6248f348 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:26.287154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-79dd83b9-6e7d-437f-b9ff-9d0e6248f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:26.365937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2bba0-ae56-4b51-b286-6d056ef69a2b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:26.395750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:26.409456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 20/43] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:26.411652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:26.412418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:26.412704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:26.413012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] PATH_INFO: `/v3/domains/default/users/6d7a1be1b9784e5783ae48b795a00917/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:26.415592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6d7a1be1b9784e5783ae48b795a00917, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:26.417445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:26.438643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd83b9-6e7d-437f-b9ff-9d0e6248f348 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:26.452097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1361 bytes} [Sun Jul 31 18:23:26 2022] PUT /identity/v3/domains/default/users/6d7a1be1b9784e5783ae48b795a00917/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:23:26.554230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd83b9-6e7d-437f-b9ff-9d0e6248f348 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:26.572976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:26.591486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5eeeb-e389-4462-8309-4ee4d1090977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:26.592168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5eeeb-e389-4462-8309-4ee4d1090977 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:26.592451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5eeeb-e389-4462-8309-4ee4d1090977 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:26.592724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5eeeb-e389-4462-8309-4ee4d1090977 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:26.593920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5eeeb-e389-4462-8309-4ee4d1090977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:26.595436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5eeeb-e389-4462-8309-4ee4d1090977 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:26.597217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 21/45] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:26.602841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:26.703528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81414c05-5e57-446e-aa9d-e4c207e4101b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:26.736191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b6f0-90d4-4049-bcba-acec477f4561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:26.736821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b6f0-90d4-4049-bcba-acec477f4561 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:26.737102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b6f0-90d4-4049-bcba-acec477f4561 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:26.737375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b6f0-90d4-4049-bcba-acec477f4561 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:26.738064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b6f0-90d4-4049-bcba-acec477f4561 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:26.739562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b6f0-90d4-4049-bcba-acec477f4561 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:26.766678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 25/46] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:23:26 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:28.429057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45868-c88a-49df-b2ec-65159b1ff558 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:28.429562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45868-c88a-49df-b2ec-65159b1ff558 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:28.429663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45868-c88a-49df-b2ec-65159b1ff558 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:28.431125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 22/47] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:28.436884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ad90a-bc73-425e-b22f-cddd9b0bb139 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:28.437302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ad90a-bc73-425e-b22f-cddd9b0bb139 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:28.437457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ad90a-bc73-425e-b22f-cddd9b0bb139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:28.456088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e04ad90a-bc73-425e-b22f-cddd9b0bb139 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:28.457287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e04ad90a-bc73-425e-b22f-cddd9b0bb139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:28.485113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:28.525367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:28.548715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e45868-c88a-49df-b2ec-65159b1ff558 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:28.648060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e45868-c88a-49df-b2ec-65159b1ff558 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:28.682388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f36e8-99e4-48cc-8178-f4a5b3419722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:28.682977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f36e8-99e4-48cc-8178-f4a5b3419722 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:28.683260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f36e8-99e4-48cc-8178-f4a5b3419722 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:28.683534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f36e8-99e4-48cc-8178-f4a5b3419722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:28.693394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f36e8-99e4-48cc-8178-f4a5b3419722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c42f36e8-99e4-48cc-8178-f4a5b3419722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:28.698240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:28.699229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:28.701010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 23/49] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:28.707822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ad90a-bc73-425e-b22f-cddd9b0bb139 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:28.795517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac170a3-e281-49eb-82c1-e30714bfb477 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:28.795817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac170a3-e281-49eb-82c1-e30714bfb477 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:28.796102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac170a3-e281-49eb-82c1-e30714bfb477 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:28.797478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 24/50] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:28.802333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0025d-c156-4fb9-bdeb-59ab524fbc91 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:28.802617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0025d-c156-4fb9-bdeb-59ab524fbc91 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:28.802894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0025d-c156-4fb9-bdeb-59ab524fbc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:28.804903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ad90a-bc73-425e-b22f-cddd9b0bb139 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:28.820491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a3d0025d-c156-4fb9-bdeb-59ab524fbc91 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:28.821694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a3d0025d-c156-4fb9-bdeb-59ab524fbc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:28.842758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:28.843416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:28.843694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:28.843967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:28.844679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:28.844983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:28.846372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:28.858084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 27/51] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:28.863686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:28.864770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:28.889759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 25/52] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:28.892278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:28.912392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0025d-c156-4fb9-bdeb-59ab524fbc91 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:28.964194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2e3e8-946a-449e-8f07-1212fcfe73ff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:28.998826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:28.999518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:28.999804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:29.000082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] PATH_INFO: `/v3/users/6d7a1be1b9784e5783ae48b795a00917` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:29.001273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] RBAC: Authorizing `identity:get_user(user_id=6d7a1be1b9784e5783ae48b795a00917)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:29.002742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:29.004389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 28/53] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:28 2022] GET /identity/v3/users/6d7a1be1b9784e5783ae48b795a00917 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:29.009702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:29.009897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0025d-c156-4fb9-bdeb-59ab524fbc91 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:29.043787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:29.044427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:29.044706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:29.044982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:29.046135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:29.047620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:29.049202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:29.054598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:29.102149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:29.108809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:29.115105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7173-1831-4090-8992-76ffb31fc7ef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:29.150344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:29.151031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:29.151319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:29.151594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:29.153376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:29.154861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:29.156514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:29.156860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302a5c0-8c73-4f8b-842c-ba96f77b1ebb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:29.162320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:29.190895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f95e0-cd6c-4fb9-8b4c-6d587764689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:29.191543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f95e0-cd6c-4fb9-8b4c-6d587764689c None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:29.191826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f95e0-cd6c-4fb9-8b4c-6d587764689c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:29.192099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f95e0-cd6c-4fb9-8b4c-6d587764689c None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:29.192781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f95e0-cd6c-4fb9-8b4c-6d587764689c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:29.194208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f95e0-cd6c-4fb9-8b4c-6d587764689c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:29.227023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 27/56] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Jul 31 18:23:29 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:23:29.264435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de03b75-1eeb-46e9-be6e-10886926cf7b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:29.302387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630a45c-7667-4bd0-89b9-a1ed3ef3649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:29.303060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a45c-7667-4bd0-89b9-a1ed3ef3649d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:29.303344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a45c-7667-4bd0-89b9-a1ed3ef3649d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:29.303623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a45c-7667-4bd0-89b9-a1ed3ef3649d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:29.304416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630a45c-7667-4bd0-89b9-a1ed3ef3649d None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.domain.id=default, user.id=6d7a1be1b9784e5783ae48b795a00917) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:29.304727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630a45c-7667-4bd0-89b9-a1ed3ef3649d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:29.306213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630a45c-7667-4bd0-89b9-a1ed3ef3649d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:29.314363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 30/57] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Jul 31 18:23:29 2022] GET /identity/v3/role_assignments?user.id=6d7a1be1b9784e5783ae48b795a00917&scope.domain.id=default&role.id=2f18a54954a047398aca6b1a7389586b => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:31.267400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e708a0-49c2-48f5-abdc-b6193ae1406e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:31.267923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e708a0-49c2-48f5-abdc-b6193ae1406e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:31.268010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e708a0-49c2-48f5-abdc-b6193ae1406e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:31.269337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:31.274451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f3367-e880-414d-ae47-dbc6442f4207 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:31.274845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f3367-e880-414d-ae47-dbc6442f4207 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:31.275034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f3367-e880-414d-ae47-dbc6442f4207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:31.293549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-921f3367-e880-414d-ae47-dbc6442f4207 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:31.294855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-921f3367-e880-414d-ae47-dbc6442f4207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:31.317291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:31.360443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:31.384694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e708a0-49c2-48f5-abdc-b6193ae1406e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:31.479063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:31.486645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e708a0-49c2-48f5-abdc-b6193ae1406e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:31.519259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb393ea4-0fe6-4a2e-a75e-0f76254006a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:31.519842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb393ea4-0fe6-4a2e-a75e-0f76254006a7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:31.520124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb393ea4-0fe6-4a2e-a75e-0f76254006a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:31.520399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb393ea4-0fe6-4a2e-a75e-0f76254006a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:31.521557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb393ea4-0fe6-4a2e-a75e-0f76254006a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:31.523078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb393ea4-0fe6-4a2e-a75e-0f76254006a7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:31.524678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:31.531196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f3367-e880-414d-ae47-dbc6442f4207 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:31.626228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f3367-e880-414d-ae47-dbc6442f4207 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:31.659125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3498b-a666-4c5a-9dc9-542e83f554f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:31.659740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3498b-a666-4c5a-9dc9-542e83f554f6 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:31.660023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3498b-a666-4c5a-9dc9-542e83f554f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:31.660298 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3498b-a666-4c5a-9dc9-542e83f554f6 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:31.660972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3498b-a666-4c5a-9dc9-542e83f554f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:31.662434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3498b-a666-4c5a-9dc9-542e83f554f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:31.689979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:23:31 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:34.687570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681c3c-c3b5-4266-a3af-b27e87bc3e7e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:34.688048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681c3c-c3b5-4266-a3af-b27e87bc3e7e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:34.688048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681c3c-c3b5-4266-a3af-b27e87bc3e7e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:34.689528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:34.700384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484104c-c4d6-427d-8d83-79415e69d2e1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:34.700810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484104c-c4d6-427d-8d83-79415e69d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:34.700985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484104c-c4d6-427d-8d83-79415e69d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:34.739951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6484104c-c4d6-427d-8d83-79415e69d2e1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:34.741148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6484104c-c4d6-427d-8d83-79415e69d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:34.761063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:34.873386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa28e-62e0-4c4d-b434-81f5bef5fc78 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:34.873667 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa28e-62e0-4c4d-b434-81f5bef5fc78 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:34.874129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa28e-62e0-4c4d-b434-81f5bef5fc78 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:34.875662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:23:34.881672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30057f5-2c65-4620-81b1-cd0978348306 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:34.882125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30057f5-2c65-4620-81b1-cd0978348306 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:34.882545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30057f5-2c65-4620-81b1-cd0978348306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:34.909835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b30057f5-2c65-4620-81b1-cd0978348306 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:34.911647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b30057f5-2c65-4620-81b1-cd0978348306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:34.915882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 33/64] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:34.949097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484104c-c4d6-427d-8d83-79415e69d2e1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.098572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 32/65] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:35.155979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30057f5-2c65-4620-81b1-cd0978348306 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.187371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484104c-c4d6-427d-8d83-79415e69d2e1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.243104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:35.243699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.243978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.244247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.276429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:35.298001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:35.298927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:35.299793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:35.303488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 34/66] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:23:35.312816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.325073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:35.343153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:35.356767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30057f5-2c65-4620-81b1-cd0978348306 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.411031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4576ab-6bd3-412f-a8d6-28552b708661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:35.412055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4576ab-6bd3-412f-a8d6-28552b708661 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.412539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4576ab-6bd3-412f-a8d6-28552b708661 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.413011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4576ab-6bd3-412f-a8d6-28552b708661 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.424932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4576ab-6bd3-412f-a8d6-28552b708661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-aa4576ab-6bd3-412f-a8d6-28552b708661 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:35.430258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:35.431250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:35.432647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:35.434806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 33/67] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:23:35.436747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea693-47fd-4669-ad12-10da29832f15 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.437256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea693-47fd-4669-ad12-10da29832f15 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.437732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea693-47fd-4669-ad12-10da29832f15 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.439237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 34/68] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:35.444566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e72556-d153-4569-8be7-a3349a33e35f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.445156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e72556-d153-4569-8be7-a3349a33e35f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.445753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e72556-d153-4569-8be7-a3349a33e35f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.447328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 35/69] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:35.448221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e72556-d153-4569-8be7-a3349a33e35f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.462901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08687d53-18d4-47fe-8546-985796da9e05 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.499817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c1a7d-268d-4428-ac16-5faa9ce0d084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:35.500367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c1a7d-268d-4428-ac16-5faa9ce0d084 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.500655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c1a7d-268d-4428-ac16-5faa9ce0d084 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.500933 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c1a7d-268d-4428-ac16-5faa9ce0d084 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.501654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c1a7d-268d-4428-ac16-5faa9ce0d084 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:35.502208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c1a7d-268d-4428-ac16-5faa9ce0d084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:35.503415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c1a7d-268d-4428-ac16-5faa9ce0d084 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:35.513193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:35.518990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9eaab-1d22-471b-9664-e7a54340031e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.519288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9eaab-1d22-471b-9664-e7a54340031e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.519572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9eaab-1d22-471b-9664-e7a54340031e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.537848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-39e9eaab-1d22-471b-9664-e7a54340031e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:35.539085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-39e9eaab-1d22-471b-9664-e7a54340031e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:35.562470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e72556-d153-4569-8be7-a3349a33e35f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.596073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137e5c7-1e0b-489e-873d-6baae93db1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:35.596695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e5c7-1e0b-489e-873d-6baae93db1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.596975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e5c7-1e0b-489e-873d-6baae93db1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.597250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e5c7-1e0b-489e-873d-6baae93db1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.597952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e5c7-1e0b-489e-873d-6baae93db1f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:35.598254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e5c7-1e0b-489e-873d-6baae93db1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:35.598406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:35.599738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137e5c7-1e0b-489e-873d-6baae93db1f0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:35.606534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 36/71] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:35.607866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:35.608004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421953-243d-4f65-b57a-333f3c411b09 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.608187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421953-243d-4f65-b57a-333f3c411b09 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.608457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421953-243d-4f65-b57a-333f3c411b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.613139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32af3f-a9c0-49b9-bdf8-95deb751586d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.613432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32af3f-a9c0-49b9-bdf8-95deb751586d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.613727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32af3f-a9c0-49b9-bdf8-95deb751586d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.615082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 37/73] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:35.615948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32af3f-a9c0-49b9-bdf8-95deb751586d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.627236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a4421953-243d-4f65-b57a-333f3c411b09 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:35.628530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4421953-243d-4f65-b57a-333f3c411b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:35.635799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:35.695506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 37/74] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:35.696367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4421953-243d-4f65-b57a-333f3c411b09 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.724451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32af3f-a9c0-49b9-bdf8-95deb751586d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.758595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21219-67e5-42e4-8a84-d2dd3bbd7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:35.759344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21219-67e5-42e4-8a84-d2dd3bbd7f79 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.759630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21219-67e5-42e4-8a84-d2dd3bbd7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.759907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21219-67e5-42e4-8a84-d2dd3bbd7f79 None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.774831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21219-67e5-42e4-8a84-d2dd3bbd7f79 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:35.776329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21219-67e5-42e4-8a84-d2dd3bbd7f79 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:35.778017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:35.780362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd584-384f-4b76-9d79-6a72ff7e4d60 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.780717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd584-384f-4b76-9d79-6a72ff7e4d60 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.780999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd584-384f-4b76-9d79-6a72ff7e4d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.796058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4421953-243d-4f65-b57a-333f3c411b09 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.798817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-510dd584-384f-4b76-9d79-6a72ff7e4d60 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:35.800044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-510dd584-384f-4b76-9d79-6a72ff7e4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:35.820926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:35.829945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:35.830590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.830876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.831186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] PATH_INFO: `/v3/users/6d7a1be1b9784e5783ae48b795a00917` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.832341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] RBAC: Authorizing `identity:get_user(user_id=6d7a1be1b9784e5783ae48b795a00917)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:35.833799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:35.835418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/users/6d7a1be1b9784e5783ae48b795a00917 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:35.836174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.867117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:35.867946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd584-384f-4b76-9d79-6a72ff7e4d60 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:35.871139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:35.938048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816133-198c-4247-abf3-14c37aba3a0b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.967731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd584-384f-4b76-9d79-6a72ff7e4d60 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:35.971358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:35.971996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:35.972271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:35.972540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:35.982502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:35.987373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:35.988253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:35.989171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:35.990702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.004772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac075722-2160-4855-9b98-818df7814533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.005420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac075722-2160-4855-9b98-818df7814533 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.005697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac075722-2160-4855-9b98-818df7814533 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.005969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac075722-2160-4855-9b98-818df7814533 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.017123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac075722-2160-4855-9b98-818df7814533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ac075722-2160-4855-9b98-818df7814533 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:36.021925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:36.022770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:36.024240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac075722-2160-4855-9b98-818df7814533 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.053620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.087727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.099072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa1be2-8ef1-483b-81aa-acca9621b9fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.125099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac075722-2160-4855-9b98-818df7814533 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.131958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.132578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.132858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.133131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.160204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.160902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.161253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.161534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.200882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.202371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.227755 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.229211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.253924 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.289037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.299426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 40/80] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:36.300242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.328236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 41/81] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:36.329063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.398528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34868a-2772-423d-b119-09da8b390a51 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.432843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.433496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.433835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.434109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.435285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.436243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2aa0-d1f7-4317-b618-8cb632830757 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.436751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.438339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:36.439120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.462786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.477508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.478125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.478404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.478678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.479422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:36.479724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.481313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.489149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:36.489916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.518663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.542848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71afb5-2b55-4000-9f91-4817ed6244a6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.576119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.576734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.577016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.577290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.578000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:36.578303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.579720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.587667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 42/84] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:36.588264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.589284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937d6ad-2205-4969-86b1-d884c4ccc161 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.624388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.625028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.625312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.625587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.626765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.628273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.630122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:36.630747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.675671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.692987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720516-c3eb-4520-8167-fb5406598a68 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.724082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.726477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.727148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.727435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.727712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.728876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.730337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.731701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7452a-c6c7-4af3-b0ab-88969143da42 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.733226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 43/86] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:36.733919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.766117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.766742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.767058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.767338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.768029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.769482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.798683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 44/87] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:23:36 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:36.799445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.838800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b863a-3853-4fbd-9423-da6a1dc7d97d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.878208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.878892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.879290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.879585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.880881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.882451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.884214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:36.885003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.914014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:36.920911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569120b1-cb69-44e6-989b-1ea0523d44b3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:36.962991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:36.963808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:36.964008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:36.964286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:36.965525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:36.967079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:36.968905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:36.969453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:36.989648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:37.030801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfad5-d16b-4fe0-abcd-542f4860a658 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:37.076864 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:37.077878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:37.078343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:37.078799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:37.079814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=cdc5991a814845be880831d8c2a0b67c) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:37.080306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:37.082148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:37.089695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 45/90] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/role_assignments?user.id=cdc5991a814845be880831d8c2a0b67c&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:37.090833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a54fa-5e6c-4286-bd13-1951aedaeace None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:37.092535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:37.144701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:37.145346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:37.145629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:37.145905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:37.146709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=6d7a1be1b9784e5783ae48b795a00917) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:37.147059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:37.149171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:37.157814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 46/91] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:36 2022] GET /identity/v3/role_assignments?user.id=6d7a1be1b9784e5783ae48b795a00917&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:37.158914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:37.224743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:37.265233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278df1-cc6e-4647-992a-d65836ef3459 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:37.271795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:37.296798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e88dc4-17e8-42d8-b585-8401a8267cc8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:37.353694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:37.354268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:37.354551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:37.354828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:37.379792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:37.380445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:37.380730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:37.381010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:37.491054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:37.492540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:37.499776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:37.501260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:37.613332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:37.613884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:37.633335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 46/92] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:37.639861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:37.662441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 47/93] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:37.668161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:37.754676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba13f12-7b65-4ab0-9c3b-bb24926fd96b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:37.796383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:37.797044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:37.797326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:37.797604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:37.798854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:37.800654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:37.802541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 47/94] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:37 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:37.808606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:37.869509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:37.937993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cd361-bdae-4769-9919-ec9bbead4ac3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:38.004609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:38.005349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:38.005636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:38.005917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:38.006728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] RBAC: Adding query filter params (role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=cdc5991a814845be880831d8c2a0b67c) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:38.007065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:38.008529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:38.020934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220fcee-2a67-4440-99ba-78259569f64b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:38.021962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 48/95] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:37 2022] GET /identity/v3/role_assignments?user.id=cdc5991a814845be880831d8c2a0b67c&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:38.091465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba617cf-d8c1-47ed-8e28-f4416238f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:38.092714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba617cf-d8c1-47ed-8e28-f4416238f6dd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:38.093194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba617cf-d8c1-47ed-8e28-f4416238f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:38.093662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba617cf-d8c1-47ed-8e28-f4416238f6dd None admin] PATH_INFO: `/v3/projects/b9cd798f2ea642dc9bb9729757d27a54` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:38.096875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba617cf-d8c1-47ed-8e28-f4416238f6dd None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd798f2ea642dc9bb9729757d27a54)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:38.098640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba617cf-d8c1-47ed-8e28-f4416238f6dd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:38.100660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:37 2022] GET /identity/v3/projects/b9cd798f2ea642dc9bb9729757d27a54 => generated 312 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:38.107305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:38.249958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec576-8148-4deb-90a3-94bda58632fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:38.268599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:38.290259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7a416-7a8d-449a-8dd5-048fc1a1f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:38.290897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a416-7a8d-449a-8dd5-048fc1a1f62d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:38.291214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a416-7a8d-449a-8dd5-048fc1a1f62d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:38.291488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a416-7a8d-449a-8dd5-048fc1a1f62d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:38.292340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7a416-7a8d-449a-8dd5-048fc1a1f62d None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=b9cd798f2ea642dc9bb9729757d27a54, user.id=cdc5991a814845be880831d8c2a0b67c) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:38.292654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7a416-7a8d-449a-8dd5-048fc1a1f62d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:38.294787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7a416-7a8d-449a-8dd5-048fc1a1f62d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:38.302588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:38 2022] GET /identity/v3/role_assignments?user.id=cdc5991a814845be880831d8c2a0b67c&scope.project.id=b9cd798f2ea642dc9bb9729757d27a54&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:39.667064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d841d-f5c7-4226-9ea1-cf8f84f1061a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:39.667914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d841d-f5c7-4226-9ea1-cf8f84f1061a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:39.669016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d841d-f5c7-4226-9ea1-cf8f84f1061a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:39.670812 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:39.675829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249abad-3aae-4a8d-b5a2-fef7b34c116c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:39.676285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249abad-3aae-4a8d-b5a2-fef7b34c116c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:39.676361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249abad-3aae-4a8d-b5a2-fef7b34c116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:39.703302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a249abad-3aae-4a8d-b5a2-fef7b34c116c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:39.704510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a249abad-3aae-4a8d-b5a2-fef7b34c116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:39.785399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 50/99] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:39.820496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d841d-f5c7-4226-9ea1-cf8f84f1061a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:39.892061 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:39.916677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae39d-3a3b-4fd7-af1e-d4e04ae90ba9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:39.916983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae39d-3a3b-4fd7-af1e-d4e04ae90ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:39.917241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae39d-3a3b-4fd7-af1e-d4e04ae90ba9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:39.920135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:39.925977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c8219-655f-40fd-84c0-f8ee08a49170 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:39.926267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c8219-655f-40fd-84c0-f8ee08a49170 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:39.926546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c8219-655f-40fd-84c0-f8ee08a49170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:39.957396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f68c8219-655f-40fd-84c0-f8ee08a49170 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:39.958323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d841d-f5c7-4226-9ea1-cf8f84f1061a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:39.967734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f68c8219-655f-40fd-84c0-f8ee08a49170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:40.052592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.053615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.054115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.054604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.056760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:40.058423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:40.063251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 50/101] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:40.067298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.112608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:40.151681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c8219-655f-40fd-84c0-f8ee08a49170 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.213098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:40.214977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f59f7-8d7e-411e-86bc-13ccd6a5ddda None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:40.234965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:40.259190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e2647-3572-4a48-ba75-27d1a7eab4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.259190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2647-3572-4a48-ba75-27d1a7eab4af None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.259190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2647-3572-4a48-ba75-27d1a7eab4af None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.259190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2647-3572-4a48-ba75-27d1a7eab4af None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.259599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e2647-3572-4a48-ba75-27d1a7eab4af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:40.259599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e2647-3572-4a48-ba75-27d1a7eab4af None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:40.289290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 51/103] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:23:40 2022] POST /identity/v3/projects => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:40.295578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a408-585f-4bff-b973-e62b65aa3fb3 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.295856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a408-585f-4bff-b973-e62b65aa3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.296086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a408-585f-4bff-b973-e62b65aa3fb3 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.297919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 52/104] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:40.299328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9228db-8023-4256-8063-589c51a515c6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.299628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9228db-8023-4256-8063-589c51a515c6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.299874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9228db-8023-4256-8063-589c51a515c6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.301284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 53/105] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:40.309520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97890f1a-96ca-4092-a346-472689b02d02 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.309883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97890f1a-96ca-4092-a346-472689b02d02 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.310066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97890f1a-96ca-4092-a346-472689b02d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.318412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c8219-655f-40fd-84c0-f8ee08a49170 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:40.354136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-97890f1a-96ca-4092-a346-472689b02d02 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:40.355820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-97890f1a-96ca-4092-a346-472689b02d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:40.389234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500fdba-9f68-4793-91ef-40a56adc4502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.390332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500fdba-9f68-4793-91ef-40a56adc4502 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.390821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500fdba-9f68-4793-91ef-40a56adc4502 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.391324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500fdba-9f68-4793-91ef-40a56adc4502 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.414694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500fdba-9f68-4793-91ef-40a56adc4502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b500fdba-9f68-4793-91ef-40a56adc4502 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:40.420821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:40.421690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:40.422498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:40.424836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 53/106] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:40.432195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511efb06-b3bd-4584-9522-eed865128aa3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.432700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511efb06-b3bd-4584-9522-eed865128aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.433261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511efb06-b3bd-4584-9522-eed865128aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.467470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-511efb06-b3bd-4584-9522-eed865128aa3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:40.469362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-511efb06-b3bd-4584-9522-eed865128aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:40.473878 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:40.474746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97890f1a-96ca-4092-a346-472689b02d02 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.548612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:40.549774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511efb06-b3bd-4584-9522-eed865128aa3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.583516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:40.597344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:40.606664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97890f1a-96ca-4092-a346-472689b02d02 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:40.644586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.645216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.645497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.645902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.646541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:40.646848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:40.648385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:40.659232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 55/109] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:40.660218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.666340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511efb06-b3bd-4584-9522-eed865128aa3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:40.703121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.704855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.705344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.705822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.717695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:40.724544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:40.725420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:40.726201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:40.728604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 55/110] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:40.729599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.771938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32549-71a2-4dc9-b78f-2ca5e9c8dd25 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:40.809758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.810416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.810697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.811000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.822770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:40.829824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:40.830703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:40.831511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 56/111] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:40.832168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.837905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:40.847963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81aafb-fb20-401f-8804-2ac5853d0f06 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:40.870668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:40.885172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.886192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.886742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.887787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] PATH_INFO: `/v3/users/0fe76d1b23ec4000aef76507ee405ce4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.903439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] RBAC: Authorizing `identity:get_user(user_id=0fe76d1b23ec4000aef76507ee405ce4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:40.905469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:40.907539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 56/112] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/users/0fe76d1b23ec4000aef76507ee405ce4 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:40.908511 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:40.947655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b170ad-64df-4729-8b78-40a290df28d4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:40.984197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:40.984746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:40.985027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:40.985303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:40.986026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:40.986332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:40.987759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:40.997091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 57/113] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:40.998050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.018699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888d80-98aa-4893-bf36-621850d7d9f6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.080218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.081288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.081773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.082330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.083287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:41.083809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.085395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.095996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 57/114] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:41.097362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.125141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.139099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.156063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66026dd-8d8d-4551-ae78-17094fe3a2bf None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.209478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16f771-7b11-45f2-bb32-0e492514a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.210465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f771-7b11-45f2-bb32-0e492514a314 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.210963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f771-7b11-45f2-bb32-0e492514a314 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.211437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f771-7b11-45f2-bb32-0e492514a314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.241294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab48be8-05e6-49b4-976a-bf833778d236 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.280881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.281620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.281904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.282179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] PATH_INFO: `/v3/users/6d7a1be1b9784e5783ae48b795a00917` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.283448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] RBAC: Authorizing `identity:get_user(user_id=6d7a1be1b9784e5783ae48b795a00917)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.284978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.287118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 58/115] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:41 2022] GET /identity/v3/users/6d7a1be1b9784e5783ae48b795a00917 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:41.287748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.308022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16f771-7b11-45f2-bb32-0e492514a314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.310746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16f771-7b11-45f2-bb32-0e492514a314 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.381266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.402258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.404810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fb3b6-097c-452a-b827-1fa2ee386abe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.420874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 58/116] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:41.426561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a0183-2088-4e69-bd72-8d1dab09eb8a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.426846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a0183-2088-4e69-bd72-8d1dab09eb8a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.427145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a0183-2088-4e69-bd72-8d1dab09eb8a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.428471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 59/117] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:41.433231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a0183-2088-4e69-bd72-8d1dab09eb8a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.446587 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fdffe-c9a1-4dc6-9780-dbcb656e547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.447311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fdffe-c9a1-4dc6-9780-dbcb656e547e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.447600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fdffe-c9a1-4dc6-9780-dbcb656e547e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.447879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fdffe-c9a1-4dc6-9780-dbcb656e547e None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.449058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fdffe-c9a1-4dc6-9780-dbcb656e547e None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.451571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fdffe-c9a1-4dc6-9780-dbcb656e547e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.453228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 59/118] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:41 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:41.454441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb5bc-37b8-4ca9-81a1-869d693eebdc None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.454721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb5bc-37b8-4ca9-81a1-869d693eebdc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.455018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb5bc-37b8-4ca9-81a1-869d693eebdc None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.460514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 60/119] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:41.461292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb5bc-37b8-4ca9-81a1-869d693eebdc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.550917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a0183-2088-4e69-bd72-8d1dab09eb8a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.568041 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb5bc-37b8-4ca9-81a1-869d693eebdc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.589578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f1924-fdd1-4220-997a-f8e24d60176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.590311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f1924-fdd1-4220-997a-f8e24d60176a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.590597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f1924-fdd1-4220-997a-f8e24d60176a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.591176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f1924-fdd1-4220-997a-f8e24d60176a None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.592223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f1924-fdd1-4220-997a-f8e24d60176a None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.593693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f1924-fdd1-4220-997a-f8e24d60176a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.595409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 60/120] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:41 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:41.596520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caa154-4c49-454d-81e2-c4b29e67e535 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.596804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caa154-4c49-454d-81e2-c4b29e67e535 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.597083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caa154-4c49-454d-81e2-c4b29e67e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.612022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.612680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.612966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.613245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.614400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.615066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d6caa154-4c49-454d-81e2-c4b29e67e535 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:41.615881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.616272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d6caa154-4c49-454d-81e2-c4b29e67e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:41.623206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 61/121] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:41 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:41.623206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.637793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.673373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.705599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 61/122] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:41.705599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffc6a4-caef-45f9-ac6d-2ea9e0ab5440 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.705599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffc6a4-caef-45f9-ac6d-2ea9e0ab5440 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.705599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffc6a4-caef-45f9-ac6d-2ea9e0ab5440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.727604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-09ffc6a4-caef-45f9-ac6d-2ea9e0ab5440 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:41.727767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3706c-f636-46a4-90fd-6e9d2ebf947d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.728800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-09ffc6a4-caef-45f9-ac6d-2ea9e0ab5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:41.763854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.764518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.764836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.765083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.766259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.767768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.769436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 62/123] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:41 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:41.774724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.807047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 62/124] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:41.807047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffc6a4-caef-45f9-ac6d-2ea9e0ab5440 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.875718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.896963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddc06c-28b0-4304-9ecc-ab45a7014d66 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.920870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffc6a4-caef-45f9-ac6d-2ea9e0ab5440 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:41.933523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.934783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.935103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.935372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/6d7a1be1b9784e5783ae48b795a00917/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.936883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:41.938181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] RBAC: Authorizing `identity:create_grant(project_id=a64c237ef8714ed3a5e65ad1aaace7ff, user_id=6d7a1be1b9784e5783ae48b795a00917, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.939695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.953093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 63/125] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:41 2022] PUT /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/6d7a1be1b9784e5783ae48b795a00917/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:23:41.953901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:41.961044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:41.961777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:41.962121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:41.962458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:41.967039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] RBAC: Adding query filter params (role.id=d799d50345d241e7a7b1a7e079d3a9b9, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=0fe76d1b23ec4000aef76507ee405ce4) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:41.967039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:41.967039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:41.976422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:41 2022] GET /identity/v3/role_assignments?user.id=0fe76d1b23ec4000aef76507ee405ce4&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=d799d50345d241e7a7b1a7e079d3a9b9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:41.977900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.105123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1a9aa-8374-46f2-9f0d-3be0955f8ba2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.151268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1707e4-c58c-491a-a862-8fc2bff983ff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.154423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.155296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.155682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.156157 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/cdc5991a814845be880831d8c2a0b67c/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.158338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] RBAC: Authorizing `identity:create_grant(project_id=a64c237ef8714ed3a5e65ad1aaace7ff, user_id=cdc5991a814845be880831d8c2a0b67c, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:42.159970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:42.183205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 64/127] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:41 2022] PUT /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/cdc5991a814845be880831d8c2a0b67c/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:23:42.184934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.220468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.221387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.221711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.221996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.232190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:42.241915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:42.249272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:42.250373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:42.251429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 64/128] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:42.256853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.260128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:42.329284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed72e-0d10-433e-88cb-0c498490457e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.372903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.373546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.373836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.374114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.389512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:42.395391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:42.397487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:42.399377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:42.403056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 65/129] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:23:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:42.404675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.463971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f888-0fc9-4d3f-bd63-964c06113f09 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.529293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:42.536424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd8c4-200b-468d-890b-3c51138fc695 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.545851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.546505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.546903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.547211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.547945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:42.548377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:42.549799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:42.566122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:42.571630 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.575441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.576084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.576368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.576643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.577556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:42.577872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:42.579309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:42.590433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:23:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:42.597744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.688248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:42.725560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b99965-18f5-4a6c-b772-ae64bc8064a0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.766196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.766975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.767273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.767555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.769431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:42.770912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:42.772738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 67/132] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:42 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:42.773399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2699c12-5db1-4e2e-a138-b8b63727c027 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.780159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.812495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:42.846595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.847400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.847691 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.847974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.849695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:42.851316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:42.853460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 66/133] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:42 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:42.859770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:42.896769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8715888-7b4b-42b7-a27b-3d6607951fa6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:42.938850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:42.939395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:42.939678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:42.939958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:42.941149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:42.942664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:42.944837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 68/134] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:42 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:42.951710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:43.068777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:43.077011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738faabc-eec3-4fd8-81ce-e0bac40025c0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:43.101972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aed91-a5b3-474e-935e-40270ae74ba5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:43.118702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cf139-cf78-468b-9de9-e690871405f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:43.119484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf139-cf78-468b-9de9-e690871405f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:43.120051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf139-cf78-468b-9de9-e690871405f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:43.120383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf139-cf78-468b-9de9-e690871405f1 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/cdc5991a814845be880831d8c2a0b67c/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:43.123562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cf139-cf78-468b-9de9-e690871405f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a64c237ef8714ed3a5e65ad1aaace7ff, user_id=cdc5991a814845be880831d8c2a0b67c, role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:43.125035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cf139-cf78-468b-9de9-e690871405f1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:43.160338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:42 2022] PUT /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/cdc5991a814845be880831d8c2a0b67c/roles/3995ac4c39964acab5ea20561b89faf8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:23:43.174062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd5f9f-6686-4568-8888-d954f9faae89 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:43.174370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd5f9f-6686-4568-8888-d954f9faae89 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:43.174616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:43.174780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd5f9f-6686-4568-8888-d954f9faae89 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:43.176056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 70/136] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:23:43.182408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528d2a-7b8f-4d7d-a1ab-f37e8982c2cc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:43.182708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528d2a-7b8f-4d7d-a1ab-f37e8982c2cc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:43.183075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528d2a-7b8f-4d7d-a1ab-f37e8982c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:43.185027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:43.185759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:43.186051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:43.186337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] PATH_INFO: `/v3/projects/b9cd798f2ea642dc9bb9729757d27a54` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:43.191041 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd798f2ea642dc9bb9729757d27a54)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:43.192520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:43.194364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 67/137] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:42 2022] GET /identity/v3/projects/b9cd798f2ea642dc9bb9729757d27a54 => generated 312 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:43.208351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:43.211741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-83528d2a-7b8f-4d7d-a1ab-f37e8982c2cc None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:43.213286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-83528d2a-7b8f-4d7d-a1ab-f37e8982c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:43.314060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 71/138] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:43.372911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83528d2a-7b8f-4d7d-a1ab-f37e8982c2cc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:43.405922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654e70-a74a-4b09-a7df-0bb9cee1e9cf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:43.529562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83528d2a-7b8f-4d7d-a1ab-f37e8982c2cc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:43.540237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:43.540946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:43.541233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:43.541514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] PATH_INFO: `/v3/projects/b9cd798f2ea642dc9bb9729757d27a54/users/cdc5991a814845be880831d8c2a0b67c/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:43.550960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:43.555760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cd798f2ea642dc9bb9729757d27a54, user_id=cdc5991a814845be880831d8c2a0b67c, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:43.557241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:43.583470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef1f85-ca13-4fb4-8cae-c6ce0ff4330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:43.584575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1f85-ca13-4fb4-8cae-c6ce0ff4330e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:43.585085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1f85-ca13-4fb4-8cae-c6ce0ff4330e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:43.585556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1f85-ca13-4fb4-8cae-c6ce0ff4330e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:43.587040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef1f85-ca13-4fb4-8cae-c6ce0ff4330e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:43.588711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef1f85-ca13-4fb4-8cae-c6ce0ff4330e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:43.599259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 68/139] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:43 2022] PUT /identity/v3/projects/b9cd798f2ea642dc9bb9729757d27a54/users/cdc5991a814845be880831d8c2a0b67c/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:23:43.600221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 72/140] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:43.608108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:43.704081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:43.762435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641fe91-a42f-496b-9e5f-5f5bc4471d04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:43.806474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f956383-0113-4d8c-8c70-25954e1b9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:43.807867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f956383-0113-4d8c-8c70-25954e1b9f17 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:43.808334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f956383-0113-4d8c-8c70-25954e1b9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:43.809693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f956383-0113-4d8c-8c70-25954e1b9f17 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:43.810615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f956383-0113-4d8c-8c70-25954e1b9f17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:43.812347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f956383-0113-4d8c-8c70-25954e1b9f17 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:43.855081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 69/141] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:23:43 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:44.879870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e07a1-02d0-4147-8ed8-e60a3c2e8eaf None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:44.880873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e07a1-02d0-4147-8ed8-e60a3c2e8eaf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:44.881335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e07a1-02d0-4147-8ed8-e60a3c2e8eaf None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:44.882914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 73/142] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:44.888559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9692b-99d8-47e8-99ea-ed890def72c2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:44.889271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9692b-99d8-47e8-99ea-ed890def72c2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:44.889355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9692b-99d8-47e8-99ea-ed890def72c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:44.914416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d9b9692b-99d8-47e8-99ea-ed890def72c2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:44.917014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9b9692b-99d8-47e8-99ea-ed890def72c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:45.055951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 70/143] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:45.062380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419a4e-cf26-40c9-8374-8d8b4da95658 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.063237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419a4e-cf26-40c9-8374-8d8b4da95658 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.064054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419a4e-cf26-40c9-8374-8d8b4da95658 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.066821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 74/144] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:23:45.084752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840d68-a985-4c9a-a6a7-ffb368f68562 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.085690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840d68-a985-4c9a-a6a7-ffb368f68562 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.086457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840d68-a985-4c9a-a6a7-ffb368f68562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.127181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0b840d68-a985-4c9a-a6a7-ffb368f68562 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:45.129317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419a4e-cf26-40c9-8374-8d8b4da95658 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:45.139061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b840d68-a985-4c9a-a6a7-ffb368f68562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:45.226104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:45.256639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 71/145] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:45.295104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840d68-a985-4c9a-a6a7-ffb368f68562 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:45.343653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419a4e-cf26-40c9-8374-8d8b4da95658 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:45.399747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:45.400356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.400639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.400913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.419520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:45.424467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:45.425374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:45.426586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 75/146] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:45.431965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:45.461247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840d68-a985-4c9a-a6a7-ffb368f68562 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:45.478662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:45.529946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9609ab-d203-489b-902f-997e7ca0857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:45.530615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9609ab-d203-489b-902f-997e7ca0857d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.530893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9609ab-d203-489b-902f-997e7ca0857d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.531185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9609ab-d203-489b-902f-997e7ca0857d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.555657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9609ab-d203-489b-902f-997e7ca0857d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fc9609ab-d203-489b-902f-997e7ca0857d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:45.561197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:45.563314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 72/147] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:45.565331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81368415-6905-4202-86b0-13ee1a1cfca3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.569946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81368415-6905-4202-86b0-13ee1a1cfca3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.569946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81368415-6905-4202-86b0-13ee1a1cfca3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.569946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 73/148] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:45.571216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b384c16-19f0-4751-bd10-78d7c47ec786 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.571216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b384c16-19f0-4751-bd10-78d7c47ec786 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.571216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b384c16-19f0-4751-bd10-78d7c47ec786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.591170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7b384c16-19f0-4751-bd10-78d7c47ec786 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:45.592361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b384c16-19f0-4751-bd10-78d7c47ec786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:45.625710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:45.643678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765938ab-2b95-45e4-a190-fb58e34817f9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:45.689900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:45.690452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.690736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.691048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.691785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:45.692093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:45.693497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:45.703350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:45.707977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:45.709147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:45.712515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b384c16-19f0-4751-bd10-78d7c47ec786 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:45.820907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:45.838564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a6aa8-556f-48a7-b47d-8c7210bfae7c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:45.894960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:45.895710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:45.895898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:45.896148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:45.896879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:45.897182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:45.898596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:45.912381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 77/151] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:45.913066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:45.965309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b384c16-19f0-4751-bd10-78d7c47ec786 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:46.045828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:46.046500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.046784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.047087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] PATH_INFO: `/v3/users/6d7a1be1b9784e5783ae48b795a00917` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.050955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] RBAC: Authorizing `identity:get_user(user_id=6d7a1be1b9784e5783ae48b795a00917)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:46.050955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:46.051545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 75/152] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:45 2022] GET /identity/v3/users/6d7a1be1b9784e5783ae48b795a00917 => generated 247 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:46.052177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:46.093148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cb173-77dc-4897-9553-69f22c74b817 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:46.123589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:46.151128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:46.151948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.153485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.153911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.161826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:46.177161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:46.183037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:46.184526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:46.185484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:46.187621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 78/153] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:46.188796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:46.285065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa806-1839-45ea-9104-9098d2795297 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:46.353198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:46.354119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.354552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.355001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.359663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:46.361374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:46.363199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 76/154] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:46 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:46.364102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:46.379568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58b77-6797-4caa-8d28-c6cea3e8253a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:46.487342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bccad-6f89-4d84-8fa1-3c2573a7d3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:46.488073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bccad-6f89-4d84-8fa1-3c2573a7d3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.488360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bccad-6f89-4d84-8fa1-3c2573a7d3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.488634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bccad-6f89-4d84-8fa1-3c2573a7d3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.531490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8f2e-8f4c-4037-904b-3aebd5b3fd7e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:46.539343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:46.599636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:46.600276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.600551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.600826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.601665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:46.601969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:46.603513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:46.612928 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 77/155] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:46.613595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:46.653085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:46.665798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bccad-6f89-4d84-8fa1-3c2573a7d3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:46.667336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bccad-6f89-4d84-8fa1-3c2573a7d3b8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:46.771991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:46.773605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824c13-2d38-454f-9a16-235242e3c262 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.773891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824c13-2d38-454f-9a16-235242e3c262 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.774161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824c13-2d38-454f-9a16-235242e3c262 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.775637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 80/157] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:46.776468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c824c13-2d38-454f-9a16-235242e3c262 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:46.797127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8971ea-cf75-4266-a08d-d46dc859d850 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:46.886011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c824c13-2d38-454f-9a16-235242e3c262 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:46.888499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:46.920948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:46.921594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.921875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.922240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.922600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:46.923306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:46.923588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:46.923863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] PATH_INFO: `/v3/users/0fe76d1b23ec4000aef76507ee405ce4` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:46.925215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] RBAC: Authorizing `identity:get_user(user_id=0fe76d1b23ec4000aef76507ee405ce4)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:46.927435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:46.929053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 81/158] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:46 2022] GET /identity/v3/users/0fe76d1b23ec4000aef76507ee405ce4 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:46.929897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:47.035960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:47.040677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03ac7d-67d6-4c78-8610-8796b183bc2a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:47.076625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799f854-05f1-4694-a7b2-5c30297ac44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:47.077186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799f854-05f1-4694-a7b2-5c30297ac44c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.077471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799f854-05f1-4694-a7b2-5c30297ac44c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.077833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799f854-05f1-4694-a7b2-5c30297ac44c None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.079034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799f854-05f1-4694-a7b2-5c30297ac44c None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:47.080484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799f854-05f1-4694-a7b2-5c30297ac44c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:47.082140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 82/159] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:46 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:47.083417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6cdd4-1395-4856-a7e0-ad4b3cbf9a16 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.083705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6cdd4-1395-4856-a7e0-ad4b3cbf9a16 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.084114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6cdd4-1395-4856-a7e0-ad4b3cbf9a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.104453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:47.106535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:47.112972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8fa6cdd4-1395-4856-a7e0-ad4b3cbf9a16 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:47.114168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8fa6cdd4-1395-4856-a7e0-ad4b3cbf9a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:47.167317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:47.217070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 83/160] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:47.217997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6cdd4-1395-4856-a7e0-ad4b3cbf9a16 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:47.280205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 78/161] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:47.281470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:47.323133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6cdd4-1395-4856-a7e0-ad4b3cbf9a16 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:47.358946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66541a-435c-43e5-81bc-c1c62d3642e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:47.359523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66541a-435c-43e5-81bc-c1c62d3642e9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.359799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66541a-435c-43e5-81bc-c1c62d3642e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.360072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66541a-435c-43e5-81bc-c1c62d3642e9 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.361243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66541a-435c-43e5-81bc-c1c62d3642e9 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:47.364398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66541a-435c-43e5-81bc-c1c62d3642e9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:47.364719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 84/162] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:47 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:47.365842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d9ec6-602e-485c-ae02-39079ae329a0 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.366118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d9ec6-602e-485c-ae02-39079ae329a0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.366391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d9ec6-602e-485c-ae02-39079ae329a0 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.367691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 85/163] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:47.368431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d9ec6-602e-485c-ae02-39079ae329a0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:47.393638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:47.400900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:47.468568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24802-ef5d-4538-9668-2e0ea159bc19 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:47.482722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d9ec6-602e-485c-ae02-39079ae329a0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:47.517861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:47.518507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.518783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.519097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.520260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:47.521700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:47.523393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 86/164] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:47 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:47.524229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:47.549892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e53ca2-6814-4039-a526-f8a2cbca04a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:47.550525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53ca2-6814-4039-a526-f8a2cbca04a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.550800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53ca2-6814-4039-a526-f8a2cbca04a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.551113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53ca2-6814-4039-a526-f8a2cbca04a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.551905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e53ca2-6814-4039-a526-f8a2cbca04a9 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=6d7a1be1b9784e5783ae48b795a00917) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:47.552217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e53ca2-6814-4039-a526-f8a2cbca04a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:47.553672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e53ca2-6814-4039-a526-f8a2cbca04a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:47.576372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 79/165] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:47 2022] GET /identity/v3/role_assignments?user.id=6d7a1be1b9784e5783ae48b795a00917&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:47.577767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc5ee-4632-48f0-850a-1ec616292d36 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.578059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc5ee-4632-48f0-850a-1ec616292d36 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.578335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc5ee-4632-48f0-850a-1ec616292d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.617681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5a6cc5ee-4632-48f0-850a-1ec616292d36 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:47.618799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a6cc5ee-4632-48f0-850a-1ec616292d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:47.724898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:47.737022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63c86-3842-495f-8a2e-b59a2efb5834 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:47.771256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 80/166] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:47.772998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc5ee-4632-48f0-850a-1ec616292d36 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:47.814497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:47.815598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:47.816103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:47.816579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:47.838293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:47.844674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:47.845607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:47.846628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:47.849233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 87/167] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:23:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:47.857406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:47.905755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:47.989901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc5ee-4632-48f0-850a-1ec616292d36 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.055043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91914b-f13a-4f7e-8da0-bcfdaa695281 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.067715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.068922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.069423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.069935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/0fe76d1b23ec4000aef76507ee405ce4/roles/d799d50345d241e7a7b1a7e079d3a9b9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.077302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] RBAC: Authorizing `identity:create_grant(project_id=a64c237ef8714ed3a5e65ad1aaace7ff, user_id=0fe76d1b23ec4000aef76507ee405ce4, role_id=d799d50345d241e7a7b1a7e079d3a9b9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:48.078800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:48.104600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 81/168] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:47 2022] PUT /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/users/0fe76d1b23ec4000aef76507ee405ce4/roles/d799d50345d241e7a7b1a7e079d3a9b9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:23:48.105956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:48.132654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.133289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.133564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.133832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.134633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=cdc5991a814845be880831d8c2a0b67c) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:48.134957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:48.137991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:48.153209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 88/169] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:47 2022] GET /identity/v3/role_assignments?user.id=cdc5991a814845be880831d8c2a0b67c&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:48.154969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:48.205472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:48.296066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5dbbf-49ee-4d77-a306-f8bad3818e28 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.312614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454c4a0-2283-4a2c-895b-189e18f50269 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.339041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97494838-e1d3-47e2-84ec-8dcadde9f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.339779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97494838-e1d3-47e2-84ec-8dcadde9f761 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.340536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97494838-e1d3-47e2-84ec-8dcadde9f761 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.340921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97494838-e1d3-47e2-84ec-8dcadde9f761 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.341717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97494838-e1d3-47e2-84ec-8dcadde9f761 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:48.342026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97494838-e1d3-47e2-84ec-8dcadde9f761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:48.343475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97494838-e1d3-47e2-84ec-8dcadde9f761 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:48.349555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:48.353443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 89/170] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:23:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:48.355993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425769-9c23-4d16-be15-4595c43fcc0f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.355993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425769-9c23-4d16-be15-4595c43fcc0f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.355993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425769-9c23-4d16-be15-4595c43fcc0f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.357556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 90/171] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:48.364447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edce8b0-ec3a-4b86-aba1-0ebcc5411f4a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.364869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edce8b0-ec3a-4b86-aba1-0ebcc5411f4a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.365155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edce8b0-ec3a-4b86-aba1-0ebcc5411f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.384655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.385685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.386184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.387517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.390961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1edce8b0-ec3a-4b86-aba1-0ebcc5411f4a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:48.390961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1edce8b0-ec3a-4b86-aba1-0ebcc5411f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:48.411976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:48.417720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:48.419453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:48.420273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:48.422807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 82/172] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:48.428103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:48.475052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 91/173] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:48.476289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edce8b0-ec3a-4b86-aba1-0ebcc5411f4a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:48.507410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:48.606225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edce8b0-ec3a-4b86-aba1-0ebcc5411f4a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.631765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b6ce-4b66-4acc-8fc9-a16c6e3d507f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.650674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.651833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.653419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.653886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.654685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:48.655050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:48.656455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:48.667568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 92/174] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:48.669614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:48.681161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a97fe-501b-496b-819e-d290150ce7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.681823 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a97fe-501b-496b-819e-d290150ce7fa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.682101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a97fe-501b-496b-819e-d290150ce7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.682372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a97fe-501b-496b-819e-d290150ce7fa None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.683728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a97fe-501b-496b-819e-d290150ce7fa None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:48.685192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a97fe-501b-496b-819e-d290150ce7fa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:48.687095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 83/175] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:48 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:48.688408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386efd6-5673-4399-ac13-200bd6a546ba None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.688693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386efd6-5673-4399-ac13-200bd6a546ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.688963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386efd6-5673-4399-ac13-200bd6a546ba None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.690415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 84/176] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:48.691718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9d7ea-5e63-4f83-b10e-f7ec7e94586f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.692060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9d7ea-5e63-4f83-b10e-f7ec7e94586f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.692336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9d7ea-5e63-4f83-b10e-f7ec7e94586f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.694977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 85/177] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:48.694977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9d7ea-5e63-4f83-b10e-f7ec7e94586f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:48.745616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:48.760400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:48.786311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda87e6-a088-47ba-a147-223e49a68bf5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.806819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9d7ea-5e63-4f83-b10e-f7ec7e94586f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.826188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.826839 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.827148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.827428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.837761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:48.843411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:48.844302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:48.845122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:48.845725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9be77-b525-4f1b-90be-cc3fe8946fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:48.845819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 93/178] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:48.845890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9be77-b525-4f1b-90be-cc3fe8946fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.845890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9be77-b525-4f1b-90be-cc3fe8946fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.845890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9be77-b525-4f1b-90be-cc3fe8946fb5 None admin] PATH_INFO: `/v3/users/cdc5991a814845be880831d8c2a0b67c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.846069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:48.851029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9be77-b525-4f1b-90be-cc3fe8946fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc5991a814845be880831d8c2a0b67c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:48.851029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9be77-b525-4f1b-90be-cc3fe8946fb5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:48.851029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 86/179] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:48 2022] GET /identity/v3/users/cdc5991a814845be880831d8c2a0b67c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:48.851271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cab98-d296-48de-8187-d38a38fdd820 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.851513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cab98-d296-48de-8187-d38a38fdd820 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.851773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cab98-d296-48de-8187-d38a38fdd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.876261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1e8cab98-d296-48de-8187-d38a38fdd820 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:48.877454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1e8cab98-d296-48de-8187-d38a38fdd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:48.952270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 87/180] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:48.953593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f931c67-c26c-4dd2-b3f6-31e76668cb2e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:48.953875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f931c67-c26c-4dd2-b3f6-31e76668cb2e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:48.954143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f931c67-c26c-4dd2-b3f6-31e76668cb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:48.969634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ca743-40c0-4624-827c-56954b7139bb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:48.972834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6f931c67-c26c-4dd2-b3f6-31e76668cb2e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:48.973760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6f931c67-c26c-4dd2-b3f6-31e76668cb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:49.012300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.013101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.013382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.013903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.018360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.018591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.045914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 88/181] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:49.046744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f931c67-c26c-4dd2-b3f6-31e76668cb2e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.099101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.100571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.157049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f931c67-c26c-4dd2-b3f6-31e76668cb2e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.193491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.194154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.194442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.194706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.195467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:49.195771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.197153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.206070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 89/182] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:49.206675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.213163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 94/183] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:49.218488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.247910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.256388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.315159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9369-1c79-47da-ac7e-f95d4941ce03 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.325676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56bcba-d6a6-4778-bf1c-4f8674021ab9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.350536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.351189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.351471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.351746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.362033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.362669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.362956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.363242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.364402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.365846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.367634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 95/184] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:49.373237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.423764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.425245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.461302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.487264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d1dd-551f-42f0-abb6-b2aaccf118ee None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.490611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.529266 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.530172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.530610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.531047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.536180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 90/185] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:49.536180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.545760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:49.550717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:49.551619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:49.552444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 96/186] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:49.553089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.645540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599180b3-3408-441f-8012-0081600c50d2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.671747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9c864-d51c-4bd8-9b6a-d43c743c752f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.681472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.682116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.682397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.682668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] PATH_INFO: `/v3/users/8d57b703e7814dd19d9a4005a97b9373` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.685935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.697119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] RBAC: Authorizing `identity:get_user(user_id=8d57b703e7814dd19d9a4005a97b9373)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.698512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.700993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 91/187] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/users/8d57b703e7814dd19d9a4005a97b9373 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:49.704286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.711064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.711714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.712000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.712273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.713431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.716127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.722573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 97/188] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:49.722573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.754334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:49.813957 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce659c27-6c84-4118-83b1-166779b73fbc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.826824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71074b44-2bcd-40b4-9b71-b02810e678b3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:49.849890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.850515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.850799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.851122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.851793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.853245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.863214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:49.864378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:49.865047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:49.865455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] PATH_INFO: `/v3/projects/b9cd798f2ea642dc9bb9729757d27a54` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:49.867267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd798f2ea642dc9bb9729757d27a54)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:49.868930 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:49.871539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 98/189] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/projects/b9cd798f2ea642dc9bb9729757d27a54 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:49.872140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.887024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 92/190] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:23:49 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:49.887024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:49.961163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:50.029829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aedd-10b4-48f7-85ee-d1e26e7ec903 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:50.038235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:50.042599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a812e7-a4c3-4ea5-9dc2-8a3376b8a275 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:50.074473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:50.075428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.075960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.076374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.084956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:50.085585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.086386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.086669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.087440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:50.087745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:50.089136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:50.100031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 99/191] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:50.101390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:50.171854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:50.173350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:50.230922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:50.248223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4729bae-40b6-4170-94b3-29299745a747 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:50.296137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:50.297304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 93/192] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:50.297575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.298046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.298528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.298973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:50.299783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] RBAC: Adding query filter params (role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=cdc5991a814845be880831d8c2a0b67c) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:50.300285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:50.307226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:50.317180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 100/193] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:50 2022] GET /identity/v3/role_assignments?user.id=cdc5991a814845be880831d8c2a0b67c&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:50.318289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:50.359443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:50.443156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294df006-63b9-4bed-bff0-736a14986482 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:50.491770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:50.492928 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.493410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.493874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.494873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=b9cd798f2ea642dc9bb9729757d27a54, user.id=cdc5991a814845be880831d8c2a0b67c) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:50.495441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:50.497289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:50.508920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 94/194] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:50 2022] GET /identity/v3/role_assignments?user.id=cdc5991a814845be880831d8c2a0b67c&scope.project.id=b9cd798f2ea642dc9bb9729757d27a54&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:50.510122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:50.541200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201938b-1e4e-48a3-b23e-935383951e25 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:50.545459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:50.632124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff4f61-6541-4318-9cae-41261322ccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:50.632799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4f61-6541-4318-9cae-41261322ccaa None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.633143 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4f61-6541-4318-9cae-41261322ccaa None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.633423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4f61-6541-4318-9cae-41261322ccaa None admin] PATH_INFO: `/v3/users/8d57b703e7814dd19d9a4005a97b9373` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.634875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff4f61-6541-4318-9cae-41261322ccaa None admin] RBAC: Authorizing `identity:get_user(user_id=8d57b703e7814dd19d9a4005a97b9373)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:50.636439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff4f61-6541-4318-9cae-41261322ccaa None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:50.640786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 101/195] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:50 2022] GET /identity/v3/users/8d57b703e7814dd19d9a4005a97b9373 => generated 283 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:50.642122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80626d6-95ca-479a-b518-184261729f56 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.642409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80626d6-95ca-479a-b518-184261729f56 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.642683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80626d6-95ca-479a-b518-184261729f56 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.644232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 102/196] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:50.653875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80626d6-95ca-479a-b518-184261729f56 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:50.718014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93dae-9148-40ef-a1bf-08964d86adf5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:50.770356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbcf01-1725-48bf-a4c9-d00db892288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:50.771037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbcf01-1725-48bf-a4c9-d00db892288e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.771322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbcf01-1725-48bf-a4c9-d00db892288e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.771751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbcf01-1725-48bf-a4c9-d00db892288e None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.775515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbcf01-1725-48bf-a4c9-d00db892288e None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:50.777195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbcf01-1725-48bf-a4c9-d00db892288e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:50.779336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 95/197] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:50 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:50.780525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21311-4fc9-472c-b0c1-c10e9887e59e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.780808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21311-4fc9-472c-b0c1-c10e9887e59e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.781087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21311-4fc9-472c-b0c1-c10e9887e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.801719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-17e21311-4fc9-472c-b0c1-c10e9887e59e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:50.803101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-17e21311-4fc9-472c-b0c1-c10e9887e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:50.809935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:50.823750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80626d6-95ca-479a-b518-184261729f56 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:50.882138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:50.883086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:50.883774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:50.884140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:50.896133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 96/198] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:50.897068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e21311-4fc9-472c-b0c1-c10e9887e59e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:50.927631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:50.991788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:50.993344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:51.053323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e21311-4fc9-472c-b0c1-c10e9887e59e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:51.101066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:51.102281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:51.102575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:51.103014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:51.103956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=8d57b703e7814dd19d9a4005a97b9373) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:51.104304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:51.106926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:51.107950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:51.115321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 97/199] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:50 2022] GET /identity/v3/role_assignments?user.id=8d57b703e7814dd19d9a4005a97b9373&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:51.116221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:51.116642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 103/200] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:51.123156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:51.214021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:51.267700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a4d4-6df0-4171-9084-da4dd01ee89a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:51.272332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6ce0-91aa-4d24-80ce-eb698d8f28ad None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:51.319641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:51.320518 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:51.320866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:51.321074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:51.325818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:51.327343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:51.329711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 104/201] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:51 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:51.337364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:51.340176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:51.341099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:51.341573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:51.342039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:51.353175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:51.359855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:51.360744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:51.361541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:51.363943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 98/202] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:51.370321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:51.435334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:51.470078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829d701-a208-4dd9-8a08-2620235e88eb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:51.509264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:51.510242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:51.510718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:51.511216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:51.513295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] RBAC: Adding query filter params (role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=8d57b703e7814dd19d9a4005a97b9373) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:51.514207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:51.515927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:51.522550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 105/203] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:51 2022] GET /identity/v3/role_assignments?user.id=8d57b703e7814dd19d9a4005a97b9373&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:51.585598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf866-ffd9-4170-b5f1-7286bf8905d7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:51.623980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:51.625073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:51.625550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:51.626012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:51.627068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:51.627584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:51.629162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:51.631982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:51.641456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 99/204] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:51.647275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:51.774171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9797-3863-4936-a595-b94abfc278b9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:51.801430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:51.810803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:51.811488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:51.811762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:51.812030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] PATH_INFO: `/v3/users/0fe76d1b23ec4000aef76507ee405ce4` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:51.813200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] RBAC: Authorizing `identity:get_user(user_id=0fe76d1b23ec4000aef76507ee405ce4)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:51.814654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:51.817243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 106/205] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:51 2022] GET /identity/v3/users/0fe76d1b23ec4000aef76507ee405ce4 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:51.824233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:51.965183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83727-7207-46c6-8599-4b874ceffc11 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:52.006344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:52.007239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:52.007658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:52.008070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:52.091453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:52.097889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:52.099742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:52.245446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 100/206] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:52.251866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:52.386914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517c0e-7377-44fd-85d3-95c7ade7375b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:52.439876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ce711-a31d-4efb-aedc-d2f747c241cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:52.440553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ce711-a31d-4efb-aedc-d2f747c241cd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:52.440834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ce711-a31d-4efb-aedc-d2f747c241cd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:52.441109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ce711-a31d-4efb-aedc-d2f747c241cd None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:52.447731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ce711-a31d-4efb-aedc-d2f747c241cd None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:52.449268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ce711-a31d-4efb-aedc-d2f747c241cd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:52.451366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 107/207] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:52 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:52.457300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:52.581781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:52.586336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb840b-25f4-47fb-85da-813da24fd71f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:52.634651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964017ac-0b97-4d6c-951b-c11ab1a6b37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:52.635330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964017ac-0b97-4d6c-951b-c11ab1a6b37a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:52.635609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964017ac-0b97-4d6c-951b-c11ab1a6b37a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:52.635878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964017ac-0b97-4d6c-951b-c11ab1a6b37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:52.637318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964017ac-0b97-4d6c-951b-c11ab1a6b37a None admin] RBAC: Adding query filter params (role.id=d799d50345d241e7a7b1a7e079d3a9b9, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff, user.id=0fe76d1b23ec4000aef76507ee405ce4) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:52.637625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964017ac-0b97-4d6c-951b-c11ab1a6b37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:52.639376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964017ac-0b97-4d6c-951b-c11ab1a6b37a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:52.645696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 101/208] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:52 2022] GET /identity/v3/role_assignments?user.id=0fe76d1b23ec4000aef76507ee405ce4&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=d799d50345d241e7a7b1a7e079d3a9b9 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:52.689114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc4cf-a2c7-4f30-a274-a415a355d82d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:52.689424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc4cf-a2c7-4f30-a274-a415a355d82d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:52.689670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc4cf-a2c7-4f30-a274-a415a355d82d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:52.691098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 108/209] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:52.696906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8879b87-4936-4867-90dd-fb0b263dab75 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:52.697205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8879b87-4936-4867-90dd-fb0b263dab75 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:52.697452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8879b87-4936-4867-90dd-fb0b263dab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:52.718600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c8879b87-4936-4867-90dd-fb0b263dab75 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:52.719813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c8879b87-4936-4867-90dd-fb0b263dab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:52.733744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48730-784d-4eb1-b0ef-f13e077bc558 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:52.734072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48730-784d-4eb1-b0ef-f13e077bc558 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:52.734281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48730-784d-4eb1-b0ef-f13e077bc558 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:52.735728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 109/210] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:23:52.741033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab56-c9d8-4f0e-a106-c87062e55928 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:52.741309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab56-c9d8-4f0e-a106-c87062e55928 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:52.741664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab56-c9d8-4f0e-a106-c87062e55928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:52.772738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a834ab56-c9d8-4f0e-a106-c87062e55928 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:52.773976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a834ab56-c9d8-4f0e-a106-c87062e55928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:52.858548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 102/211] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:52.882853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:52.886869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8879b87-4936-4867-90dd-fb0b263dab75 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:52.900852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 110/212] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:52.928660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ab56-c9d8-4f0e-a106-c87062e55928 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.010113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:53.024703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8879b87-4936-4867-90dd-fb0b263dab75 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:53.069991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ab56-c9d8-4f0e-a106-c87062e55928 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:53.077883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:53.081903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.081903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.081903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.094265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:53.101868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:53.102787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:53.103952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 103/213] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:23:53.109671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.118688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:53.119657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.120446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.121053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.122295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:53.123920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:53.125895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 111/214] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:53.131248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.227300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:53.233407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b244e-0777-40fb-8d90-0207e722efec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:53.253295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecda07-c1af-4d7e-adab-8387c7ca10bc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:53.284593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:53.285223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.285504 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.285776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.286494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:53.286794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:53.288221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:53.299293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:53.300008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.300351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.300570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 104/215] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:53.300666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.301303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:53.302775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:53.306057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.326800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:53.336428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 112/216] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:23:53 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:23:53.441135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08433610-9e19-4ad0-b43c-697f6aec5f79 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:53.479659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0274e9-9245-4315-84c3-08e89de257c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:53.481267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0274e9-9245-4315-84c3-08e89de257c1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.481598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0274e9-9245-4315-84c3-08e89de257c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.481997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0274e9-9245-4315-84c3-08e89de257c1 None admin] PATH_INFO: `/v3/users/fc2f54a84e8141c080096289265d8c1e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.497816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0274e9-9245-4315-84c3-08e89de257c1 None admin] RBAC: Authorizing `identity:get_user(user_id=fc2f54a84e8141c080096289265d8c1e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:53.499390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0274e9-9245-4315-84c3-08e89de257c1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:53.501464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 105/217] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:53 2022] GET /identity/v3/users/fc2f54a84e8141c080096289265d8c1e => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:53.507231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.613603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96aa37-f4a0-4cd4-b29b-ea0d307b6b49 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.614250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96aa37-f4a0-4cd4-b29b-ea0d307b6b49 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.614736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96aa37-f4a0-4cd4-b29b-ea0d307b6b49 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.616344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 106/218] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:53.621031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fae2a-2f04-4d3d-8d2c-acb4251b471b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:53.622374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11239d66-94e1-4500-a7ff-90b5cb8336b8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.622733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11239d66-94e1-4500-a7ff-90b5cb8336b8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.623050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11239d66-94e1-4500-a7ff-90b5cb8336b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.641247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:53.649162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-11239d66-94e1-4500-a7ff-90b5cb8336b8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:53.650651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-11239d66-94e1-4500-a7ff-90b5cb8336b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:53.662961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:53.664057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.664337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.664608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.738474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 107/219] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:53.743446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:53.745161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:53.765982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11239d66-94e1-4500-a7ff-90b5cb8336b8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.768289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:53.868020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 113/220] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:53.874584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.903296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:53.906883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11239d66-94e1-4500-a7ff-90b5cb8336b8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:53.953009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:53.953672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:53.953967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:53.954487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:53.969462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:53.975201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:53.976084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:53.977553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 108/221] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:23:53.982447 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:53.992103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8798c06-d564-4c10-9e68-4176ff2f4b44 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.029319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.030409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.030923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.031425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.032837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:54.034502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:54.041469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 114/222] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:53 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:54.043095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:54.084600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:54.128475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320c126-b2ed-4ae4-8c9f-257d15d958d9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.157285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:54.167127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789ee62-a3ba-40ad-b0cf-6b1eb1b966bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.168371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789ee62-a3ba-40ad-b0cf-6b1eb1b966bb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.168821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789ee62-a3ba-40ad-b0cf-6b1eb1b966bb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.169018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789ee62-a3ba-40ad-b0cf-6b1eb1b966bb None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.169774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789ee62-a3ba-40ad-b0cf-6b1eb1b966bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:54.170353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789ee62-a3ba-40ad-b0cf-6b1eb1b966bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:54.171529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789ee62-a3ba-40ad-b0cf-6b1eb1b966bb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:54.181362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6090-39e3-4202-9f5d-996dac7d88d6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.181666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 109/223] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:54.182682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a317e-7d9c-4fd6-9167-3b6735e41ed4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.182986 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a317e-7d9c-4fd6-9167-3b6735e41ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.183880 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a317e-7d9c-4fd6-9167-3b6735e41ed4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.185110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 110/224] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:54.189916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a317e-7d9c-4fd6-9167-3b6735e41ed4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:54.229387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0094e-9bda-4009-92ac-d8c87166c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.230771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0094e-9bda-4009-92ac-d8c87166c9ff None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.231217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0094e-9bda-4009-92ac-d8c87166c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.231629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0094e-9bda-4009-92ac-d8c87166c9ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.232551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0094e-9bda-4009-92ac-d8c87166c9ff None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=fc2f54a84e8141c080096289265d8c1e) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:54.233021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0094e-9bda-4009-92ac-d8c87166c9ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:54.235159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0094e-9bda-4009-92ac-d8c87166c9ff None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:54.243936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 115/225] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:54 2022] GET /identity/v3/role_assignments?user.id=fc2f54a84e8141c080096289265d8c1e&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:54.251266 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec29b9-1da7-417a-b6ea-88cda981bb71 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.251266 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec29b9-1da7-417a-b6ea-88cda981bb71 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.251266 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec29b9-1da7-417a-b6ea-88cda981bb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.272616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-73ec29b9-1da7-417a-b6ea-88cda981bb71 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:54.273865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-73ec29b9-1da7-417a-b6ea-88cda981bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:54.329792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a317e-7d9c-4fd6-9167-3b6735e41ed4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.362483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:54.379196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.380232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.380793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.381265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] PATH_INFO: `/v3/users/8d57b703e7814dd19d9a4005a97b9373` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.383057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] RBAC: Authorizing `identity:get_user(user_id=8d57b703e7814dd19d9a4005a97b9373)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:54.384760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:54.386794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:54 2022] GET /identity/v3/users/8d57b703e7814dd19d9a4005a97b9373 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:54.392780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:54.396086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 116/227] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:54.431302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec29b9-1da7-417a-b6ea-88cda981bb71 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:54.526533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff5de3-9ea1-4219-986b-0469f2a9ff38 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.594589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.595277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.595556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.596992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.598717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:54.600209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:54.602453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 112/228] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:54 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:54.604014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:54.609977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:54.643256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec29b9-1da7-417a-b6ea-88cda981bb71 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.705324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.705972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.706289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.706561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.717305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:54.726583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:54.731661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:54.732613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:54.733405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:23:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:23:54.744035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:54.779322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952db9-52ae-4d6c-9311-b3f4ae52aebd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.846025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.846829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.847176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.847452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/8d57b703e7814dd19d9a4005a97b9373/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.849529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] RBAC: Authorizing `identity:create_grant(project_id=1802d8d1d6e34024a1209fbec590f788, user_id=8d57b703e7814dd19d9a4005a97b9373, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:54.851246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:54.858141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bc491-9558-493b-8c5d-f2428899a44e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:54.882547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 113/230] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:54 2022] PUT /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/8d57b703e7814dd19d9a4005a97b9373/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:23:54.906499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:54.907530 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:54.908011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:54.908518 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:54.909454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:54.909952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:54.911560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:54.917503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:54.929855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 118/231] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:23:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:54.936399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:55.079714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803a05-23bc-4271-b4d3-455cafeb928b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:55.105055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:55.126131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:55.126799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:55.127115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:55.127390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] PATH_INFO: `/v3/users/8d57b703e7814dd19d9a4005a97b9373` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:55.128608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] RBAC: Authorizing `identity:get_user(user_id=8d57b703e7814dd19d9a4005a97b9373)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:55.130069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:55.131758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 114/232] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:54 2022] GET /identity/v3/users/8d57b703e7814dd19d9a4005a97b9373 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:55.138396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:55.278192 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9990-287d-4157-9b14-f27f4e169329 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:55.323269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a7da8-35aa-4cc8-8e05-a6c40874a8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:55.323954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a7da8-35aa-4cc8-8e05-a6c40874a8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:55.324332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a7da8-35aa-4cc8-8e05-a6c40874a8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:55.324826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a7da8-35aa-4cc8-8e05-a6c40874a8b6 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:55.326131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a7da8-35aa-4cc8-8e05-a6c40874a8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:55.327616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a7da8-35aa-4cc8-8e05-a6c40874a8b6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:55.329292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 119/233] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:55 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:23:55.335207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:55.488543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5718bcb-f9d1-49ea-a5f3-d90999c56f46 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:55.536649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd62e3f-0ccd-4657-9875-4816d10cd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:55.537331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd62e3f-0ccd-4657-9875-4816d10cd8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:55.537608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd62e3f-0ccd-4657-9875-4816d10cd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:55.537879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd62e3f-0ccd-4657-9875-4816d10cd8f3 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/8d57b703e7814dd19d9a4005a97b9373/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:55.545219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd62e3f-0ccd-4657-9875-4816d10cd8f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1802d8d1d6e34024a1209fbec590f788, user_id=8d57b703e7814dd19d9a4005a97b9373, role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:55.546682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd62e3f-0ccd-4657-9875-4816d10cd8f3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:55.581664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 115/234] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:55 2022] PUT /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/8d57b703e7814dd19d9a4005a97b9373/roles/3995ac4c39964acab5ea20561b89faf8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:23:56.090597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca125d-8da9-4a2c-8d3b-cf9f2310c853 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.090993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca125d-8da9-4a2c-8d3b-cf9f2310c853 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.091193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca125d-8da9-4a2c-8d3b-cf9f2310c853 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.092847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 120/235] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:56.098420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307415b-150b-410d-98a6-4c0f76a3dcc1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.098710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307415b-150b-410d-98a6-4c0f76a3dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.099015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307415b-150b-410d-98a6-4c0f76a3dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.125006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a307415b-150b-410d-98a6-4c0f76a3dcc1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:56.126220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a307415b-150b-410d-98a6-4c0f76a3dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:56.178842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:56.208374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 116/236] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:56.237466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca125d-8da9-4a2c-8d3b-cf9f2310c853 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:56.310496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:56.362748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca125d-8da9-4a2c-8d3b-cf9f2310c853 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:56.405465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:56.406117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.406394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.406666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.408778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc50f-02cb-43b0-87d4-9bbeb47d76d1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.409210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc50f-02cb-43b0-87d4-9bbeb47d76d1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.409388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc50f-02cb-43b0-87d4-9bbeb47d76d1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.411078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 117/237] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:56.415920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f5912-e100-411b-ae29-73b5ba6d24b8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.416204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f5912-e100-411b-ae29-73b5ba6d24b8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.416478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f5912-e100-411b-ae29-73b5ba6d24b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.422681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:56.428632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:56.429535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:23:56.430341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 121/238] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:56.439912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:56.447195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3e4f5912-e100-411b-ae29-73b5ba6d24b8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:56.448441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3e4f5912-e100-411b-ae29-73b5ba6d24b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:56.560850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 118/239] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:56.593312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d7556-6307-4714-aee1-af1029b288e2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:56.625093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f5912-e100-411b-ae29-73b5ba6d24b8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:56.629292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:56.639627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:56.640256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.640538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.640813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.641544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:56.641848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:56.643391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:56.653575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 122/240] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:56.659808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:56.767542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f5912-e100-411b-ae29-73b5ba6d24b8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:56.777599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:56.805004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa04335-902b-4190-81ae-c60c30c0f6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:56.805690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea828-ce0e-476f-8f9e-63976cad7eff None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:56.805920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa04335-902b-4190-81ae-c60c30c0f6ce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.806301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa04335-902b-4190-81ae-c60c30c0f6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.806672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa04335-902b-4190-81ae-c60c30c0f6ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.808004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa04335-902b-4190-81ae-c60c30c0f6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:56.809651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa04335-902b-4190-81ae-c60c30c0f6ce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:56.811727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 119/241] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:56.812969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64f34-7680-425d-a51d-89aba06fcca1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.813352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64f34-7680-425d-a51d-89aba06fcca1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.813724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64f34-7680-425d-a51d-89aba06fcca1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.815210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 120/242] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:56.819893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb64f34-7680-425d-a51d-89aba06fcca1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:56.846665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba0e2f-3de0-44c9-814f-35104c02eb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:56.847353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0e2f-3de0-44c9-814f-35104c02eb3b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.847886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0e2f-3de0-44c9-814f-35104c02eb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.848165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0e2f-3de0-44c9-814f-35104c02eb3b None admin] PATH_INFO: `/v3/users/9a39cecaff0b428d9a0d4df8f6b4d0fd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.864665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba0e2f-3de0-44c9-814f-35104c02eb3b None admin] RBAC: Authorizing `identity:get_user(user_id=9a39cecaff0b428d9a0d4df8f6b4d0fd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:56.866220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba0e2f-3de0-44c9-814f-35104c02eb3b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:56.868172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 123/243] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:56 2022] GET /identity/v3/users/9a39cecaff0b428d9a0d4df8f6b4d0fd => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:56.869345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e22a-7edd-4ce3-a52d-fcca384a7440 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.869686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e22a-7edd-4ce3-a52d-fcca384a7440 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.869963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e22a-7edd-4ce3-a52d-fcca384a7440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.889586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c416e22a-7edd-4ce3-a52d-fcca384a7440 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:56.890755 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c416e22a-7edd-4ce3-a52d-fcca384a7440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:56.937499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:56.952535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb64f34-7680-425d-a51d-89aba06fcca1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:56.967264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 124/244] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:56.968400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416e22a-7edd-4ce3-a52d-fcca384a7440 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:56.992819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:56.993724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:56.994005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:56.994278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:56.995216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:56.997815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:57.023333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 121/245] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:23:56 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:23:57.024268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.064125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:57.136884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416e22a-7edd-4ce3-a52d-fcca384a7440 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.149556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7b28-fabb-4439-9843-9044fee55f80 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.188635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:57.189395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.189968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.190476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.194308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ab394-6e44-4883-9644-27754069ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:57.194978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ab394-6e44-4883-9644-27754069ccfb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.195262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ab394-6e44-4883-9644-27754069ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.195535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ab394-6e44-4883-9644-27754069ccfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.203816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:57.209753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:57.210884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:23:57.211867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:57.214203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 122/246] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:57.221004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.282090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:57.305988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ab394-6e44-4883-9644-27754069ccfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:57.307772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ab394-6e44-4883-9644-27754069ccfb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:57.348631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:57.352628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a800-a4f7-479d-9112-0116645b0097 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.394883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc6478-17c4-4cc2-bf91-bc4389ac7c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:57.395856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6478-17c4-4cc2-bf91-bc4389ac7c38 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.396148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6478-17c4-4cc2-bf91-bc4389ac7c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.396422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6478-17c4-4cc2-bf91-bc4389ac7c38 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.397312 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc6478-17c4-4cc2-bf91-bc4389ac7c38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:57.397621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc6478-17c4-4cc2-bf91-bc4389ac7c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:57.399103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc6478-17c4-4cc2-bf91-bc4389ac7c38 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:57.413205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 123/247] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:57.418715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c89d-0c42-459d-8c17-5cb8303a3f40 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.418715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c89d-0c42-459d-8c17-5cb8303a3f40 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.418715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c89d-0c42-459d-8c17-5cb8303a3f40 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.420533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 124/248] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:57.421234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c89d-0c42-459d-8c17-5cb8303a3f40 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.430414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 125/249] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:57.431790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86388bd-94cb-4987-b1cf-e8779bd8d4ad None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.434078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86388bd-94cb-4987-b1cf-e8779bd8d4ad None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.434078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86388bd-94cb-4987-b1cf-e8779bd8d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.458380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a86388bd-94cb-4987-b1cf-e8779bd8d4ad None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:57.459619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a86388bd-94cb-4987-b1cf-e8779bd8d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:57.539176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 126/250] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:23:57.540624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86388bd-94cb-4987-b1cf-e8779bd8d4ad None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.552314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:57.553277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c89d-0c42-459d-8c17-5cb8303a3f40 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.603169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:57.604477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.604990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.606032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] PATH_INFO: `/v3/users/fc2f54a84e8141c080096289265d8c1e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.607972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] RBAC: Authorizing `identity:get_user(user_id=fc2f54a84e8141c080096289265d8c1e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:57.610154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:57.612666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 125/251] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/users/fc2f54a84e8141c080096289265d8c1e => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:57.613671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.650771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:57.680757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86388bd-94cb-4987-b1cf-e8779bd8d4ad None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.727113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:57.727768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.728056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.731076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.731076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:57.731076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:57.733056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 127/252] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:57.734294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.747873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75ed4-64c2-4343-b246-b10e6a2d755c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.788203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:57.789211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.789781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.790286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.802110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:57.808811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:57.809716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:23:57.810525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:57.813362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 126/253] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:57.814484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.815208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:57.842002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb567-e38a-4fff-9dd3-92bd56f50444 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.878376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:57.879073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:57.879360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:57.879884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:57.880863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:57.882284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:57.887965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 128/254] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:57.887965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:57.924845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:57.956665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125647de-ce14-4b42-9fb2-bee6b3f72229 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:57.992816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9fbd-e2b8-4f74-8a90-85af63c200c4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:58.004450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:58.005500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.005995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.006462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.007468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] RBAC: Adding query filter params (role.id=d799d50345d241e7a7b1a7e079d3a9b9, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=9a39cecaff0b428d9a0d4df8f6b4d0fd) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:58.008021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:58.009871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:58.022038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 127/255] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/role_assignments?user.id=9a39cecaff0b428d9a0d4df8f6b4d0fd&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=d799d50345d241e7a7b1a7e079d3a9b9 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:58.023470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:58.047647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:58.048290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.048575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.048853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.049588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:58.049901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:58.051432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:58.085300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 129/256] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:58.093998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:58.110631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:58.242285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4dcf4-630b-4e1e-a86f-48ba9f62f3ab None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:58.278996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacff04-d073-47df-be71-e5fa02f69c82 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:58.279962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee55647-d45f-4982-b408-d839d5dfbaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:58.280908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee55647-d45f-4982-b408-d839d5dfbaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.281164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee55647-d45f-4982-b408-d839d5dfbaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.281439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee55647-d45f-4982-b408-d839d5dfbaf8 None admin] PATH_INFO: `/v3/users/8d57b703e7814dd19d9a4005a97b9373` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.282619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee55647-d45f-4982-b408-d839d5dfbaf8 None admin] RBAC: Authorizing `identity:get_user(user_id=8d57b703e7814dd19d9a4005a97b9373)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:58.284133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee55647-d45f-4982-b408-d839d5dfbaf8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:58.286067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 130/257] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:58 2022] GET /identity/v3/users/8d57b703e7814dd19d9a4005a97b9373 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:58.288326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066782-6dbf-409e-80aa-22dfa2e3ae27 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.288613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066782-6dbf-409e-80aa-22dfa2e3ae27 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.288892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066782-6dbf-409e-80aa-22dfa2e3ae27 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.290138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 131/258] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:23:58.296682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d075-8d7f-4e1e-a964-da00e014e7ac None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.297036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d075-8d7f-4e1e-a964-da00e014e7ac None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.297380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d075-8d7f-4e1e-a964-da00e014e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.318863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b248d075-8d7f-4e1e-a964-da00e014e7ac None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:23:58.320561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b248d075-8d7f-4e1e-a964-da00e014e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:23:58.364234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:58.364932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.365219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.365500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/fc2f54a84e8141c080096289265d8c1e/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.367526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=1802d8d1d6e34024a1209fbec590f788, user_id=fc2f54a84e8141c080096289265d8c1e, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:58.368993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:58.396230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:23:58.397049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248d075-8d7f-4e1e-a964-da00e014e7ac None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:58.401694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 128/260] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:23:58 2022] PUT /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/fc2f54a84e8141c080096289265d8c1e/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:23:58.407552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:58.452011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:58.468876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:58.572902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248d075-8d7f-4e1e-a964-da00e014e7ac None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:58.656561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:58.657562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.658062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.658531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.669631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67779213-cc3b-4f78-9c4e-2e7007bf4c48 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:58.730763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:58.732633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:58.743320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:58.755302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:58.755978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:58.756258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:58.756534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:58.782130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:23:58.788562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:23:58.789446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:23:58.790262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:23:58.795376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 129/261] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:23:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:23:58.803937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:58.851452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 133/262] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:23:58.857932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:58.922958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:58.979791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6172a-8c60-4024-bd89-eb802d4602e8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:59.033513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a9fbc-fbae-43cf-968d-2d8a9735ebec None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:59.043384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:59.045328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:59.046254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:59.046736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:59.047240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:59.048175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:59.051868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:59.051868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:59.066263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 130/263] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:23:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:59.072453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:59.100693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:59.103097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:59.103097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:59.103097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:59.103337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:59.104782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:59.107235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 134/264] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:58 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:59.116027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:59.248738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730ddea-f4ef-434d-bdac-3a092c20fe72 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:59.283618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:59.288626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:59.289288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:59.289576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:59.289854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] PATH_INFO: `/v3/users/8d57b703e7814dd19d9a4005a97b9373` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:59.291092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] RBAC: Authorizing `identity:get_user(user_id=8d57b703e7814dd19d9a4005a97b9373)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:59.292635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:59.294589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 131/265] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:23:59 2022] GET /identity/v3/users/8d57b703e7814dd19d9a4005a97b9373 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:59.300683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:59.318138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1476f-be85-48d4-af94-c6c158cbfe57 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:59.381974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:59.383563 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:59.383844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:59.384120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:59.384916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=8d57b703e7814dd19d9a4005a97b9373) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:23:59.385228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:59.386769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:59.402548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 135/266] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:59 2022] GET /identity/v3/role_assignments?user.id=8d57b703e7814dd19d9a4005a97b9373&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:59.452573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b835-0352-49f9-aace-dacc1389b6ce None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:59.489354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:59.490005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:59.490289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:59.490568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:59.560057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:59.567488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:59.568991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:59.677664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 132/267] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 18:23:59.683364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:59.721661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:59.801516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548d75-eaf9-4cea-baaf-9b651d671979 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:23:59.844189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7268-a76c-440d-a1aa-be4d6304430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:23:59.844846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7268-a76c-440d-a1aa-be4d6304430f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:23:59.845126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7268-a76c-440d-a1aa-be4d6304430f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:23:59.845403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7268-a76c-440d-a1aa-be4d6304430f None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:23:59.847389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7268-a76c-440d-a1aa-be4d6304430f None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:23:59.848915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7268-a76c-440d-a1aa-be4d6304430f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:23:59.850639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 136/268] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:23:59 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:23:59.856841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:23:59.966675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:23:59.973690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9bee2-f15a-44ea-8119-7ef4f04545fe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:00.012995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9668-c0fb-4e72-85cd-0a89f7feb35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:00.013676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9668-c0fb-4e72-85cd-0a89f7feb35b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.014217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9668-c0fb-4e72-85cd-0a89f7feb35b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.014491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9668-c0fb-4e72-85cd-0a89f7feb35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.015317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9668-c0fb-4e72-85cd-0a89f7feb35b None admin] RBAC: Adding query filter params (role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=8d57b703e7814dd19d9a4005a97b9373) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:00.015628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9668-c0fb-4e72-85cd-0a89f7feb35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:00.017109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9668-c0fb-4e72-85cd-0a89f7feb35b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:00.023475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 133/269] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:23:59 2022] GET /identity/v3/role_assignments?user.id=8d57b703e7814dd19d9a4005a97b9373&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:00.242196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930623d-94e3-4275-970f-a8f8087cd64d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.242542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930623d-94e3-4275-970f-a8f8087cd64d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.242717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930623d-94e3-4275-970f-a8f8087cd64d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.244319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 137/270] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:00.250216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d075b-4cd2-470d-b491-cc646cba3a4b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.250771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d075b-4cd2-470d-b491-cc646cba3a4b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.251280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d075b-4cd2-470d-b491-cc646cba3a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.271507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2a5d075b-4cd2-470d-b491-cc646cba3a4b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:00.273072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2a5d075b-4cd2-470d-b491-cc646cba3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:00.351041 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 134/271] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:00.368870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930623d-94e3-4275-970f-a8f8087cd64d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:00.410975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99779ce2-016c-4941-b289-b5f377ee4a7f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.411583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99779ce2-016c-4941-b289-b5f377ee4a7f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.412049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99779ce2-016c-4941-b289-b5f377ee4a7f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.413854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 135/272] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:00.419459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9879358-edc9-4609-ab66-9ee2e2cfa0c7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.420021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9879358-edc9-4609-ab66-9ee2e2cfa0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.420488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9879358-edc9-4609-ab66-9ee2e2cfa0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.447804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b9879358-edc9-4609-ab66-9ee2e2cfa0c7 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:00.450091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9879358-edc9-4609-ab66-9ee2e2cfa0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:00.499355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930623d-94e3-4275-970f-a8f8087cd64d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:00.502055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:00.534833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 136/273] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:00.542260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:00.542260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.543158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.543510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.558999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:00.565832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:00.566714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:00.567611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:00.569553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9879358-edc9-4609-ab66-9ee2e2cfa0c7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:00.571690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 138/274] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:00.572922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:00.593369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:00.677976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946343c-0faa-45d9-bc56-bff9a8708c8e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:00.696371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9879358-edc9-4609-ab66-9ee2e2cfa0c7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:00.711938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:00.712551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.712827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.713097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.713808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:00.714108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:00.716102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:00.725574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 139/275] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:00.732447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:00.744332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:00.745075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.745898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.746323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.747488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:00.749777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:00.756075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 137/276] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:00.758308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:00.769198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:00.866069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:00.867638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39df89-0925-4976-8721-daff6e25b721 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:00.890350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967580d3-031c-4717-9bf6-12c1c75e128e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:00.906774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6bb83-2596-46f1-a581-254dd7933ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:00.907470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6bb83-2596-46f1-a581-254dd7933ccc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.907792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6bb83-2596-46f1-a581-254dd7933ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.908072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6bb83-2596-46f1-a581-254dd7933ccc None admin] PATH_INFO: `/v3/users/0c65ddba4f1741a9afaf4c2314192eda` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.922976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6bb83-2596-46f1-a581-254dd7933ccc None admin] RBAC: Authorizing `identity:get_user(user_id=0c65ddba4f1741a9afaf4c2314192eda)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:00.924468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6bb83-2596-46f1-a581-254dd7933ccc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:00.926377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 140/277] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:00 2022] GET /identity/v3/users/0c65ddba4f1741a9afaf4c2314192eda => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:00.927367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555303f-4c10-4564-8516-36f4443f34c9 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.927649 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555303f-4c10-4564-8516-36f4443f34c9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.927921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555303f-4c10-4564-8516-36f4443f34c9 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.929241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 141/278] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:00.934806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f4df-4cf3-4361-aa9f-d9515dbc6ce0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.935133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f4df-4cf3-4361-aa9f-d9515dbc6ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.935477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f4df-4cf3-4361-aa9f-d9515dbc6ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.938207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:00.938838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:00.939135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:00.939404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:00.940083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:00.941515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:00.954001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e1a3f4df-4cf3-4361-aa9f-d9515dbc6ce0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:00.955261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e1a3f4df-4cf3-4361-aa9f-d9515dbc6ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:00.967243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 138/279] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:24:00 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:00.968084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:01.047217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 142/280] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:01.066300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3f4df-4cf3-4361-aa9f-d9515dbc6ce0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:01.099220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:01.103672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f20b-475b-4a6b-a36c-d877219db85f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:01.150989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:01.150989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.150989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.150989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.151382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, user.id=0c65ddba4f1741a9afaf4c2314192eda, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:01.151648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:01.153171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:01.159714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 139/281] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Jul 31 18:24:00 2022] GET /identity/v3/role_assignments?user.id=0c65ddba4f1741a9afaf4c2314192eda&scope.system=all&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:01.180818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3f4df-4cf3-4361-aa9f-d9515dbc6ce0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:01.224956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f76a33-c1e7-42a6-adc2-fc56b6852b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:01.225633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76a33-c1e7-42a6-adc2-fc56b6852b77 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.225913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76a33-c1e7-42a6-adc2-fc56b6852b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.226183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76a33-c1e7-42a6-adc2-fc56b6852b77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.240368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f76a33-c1e7-42a6-adc2-fc56b6852b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-64f76a33-c1e7-42a6-adc2-fc56b6852b77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:01.245842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:01.246955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:01.248425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 143/282] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:01.253155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:01.267376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:01.311465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9f24f-6cf4-4178-a3ef-f1017aa82635 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.311752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9f24f-6cf4-4178-a3ef-f1017aa82635 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.311945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9f24f-6cf4-4178-a3ef-f1017aa82635 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.313372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 144/283] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:01.319103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8840b-dc2d-4da3-8dd5-35f0a071aaf1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.319387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8840b-dc2d-4da3-8dd5-35f0a071aaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.319657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8840b-dc2d-4da3-8dd5-35f0a071aaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.343675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2ef8840b-dc2d-4da3-8dd5-35f0a071aaf1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:01.344980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2ef8840b-dc2d-4da3-8dd5-35f0a071aaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:01.382039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54478-d548-4e58-8286-c455b97a21af None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:01.425576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:01.429364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.429364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.429364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.429364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:01.429364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:01.430666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:01.440459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 145/284] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:01.445683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 140/285] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:01.452990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8840b-dc2d-4da3-8dd5-35f0a071aaf1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:01.464001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:01.469974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:01.585336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:01.633761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8840b-dc2d-4da3-8dd5-35f0a071aaf1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:01.634872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66011acc-b98b-43d8-a095-6843b8df08dc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:01.692014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:01.692213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.692454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.692724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.707000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:01.707654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.707926 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.708194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] PATH_INFO: `/v3/users/9a39cecaff0b428d9a0d4df8f6b4d0fd` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.709600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=9a39cecaff0b428d9a0d4df8f6b4d0fd)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:01.711084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:01.712846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 146/286] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:01 2022] GET /identity/v3/users/9a39cecaff0b428d9a0d4df8f6b4d0fd => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:01.713371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:01.719261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:01.720174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:01.720979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:01.721592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:01.723656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 141/287] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:01.728238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:01.850476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:01.874885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fe987-a3ae-4ab6-869a-ce445137283d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:01.913448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:01.914075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:01.914351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:01.914621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:01.915798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:01.916101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:01.917869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:01.920277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340489-f33c-4b88-b446-2056ef016ef8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:01.927284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:01.931884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 142/288] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:01.933857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:02.002125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:02.003067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:02.003489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:02.003909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:02.006202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:02.007840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:02.009820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 147/289] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:01 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:02.016430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:02.096758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e974-d635-4c68-81a0-8bb47ad1bcbd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:02.162371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:02.164111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:02.164749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:02.165191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] PATH_INFO: `/v3/users/fc2f54a84e8141c080096289265d8c1e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:02.167487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] RBAC: Authorizing `identity:get_user(user_id=fc2f54a84e8141c080096289265d8c1e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:02.171249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:02.174415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 143/290] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:01 2022] GET /identity/v3/users/fc2f54a84e8141c080096289265d8c1e => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:02.182714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:02.206734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913f226-0d7a-47a7-a8d7-bb6afa33d264 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:02.269176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:02.270705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:02.271341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:02.272731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/9a39cecaff0b428d9a0d4df8f6b4d0fd/roles/d799d50345d241e7a7b1a7e079d3a9b9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:02.275344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:02.276252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] RBAC: Authorizing `identity:create_grant(project_id=1802d8d1d6e34024a1209fbec590f788, user_id=9a39cecaff0b428d9a0d4df8f6b4d0fd, role_id=d799d50345d241e7a7b1a7e079d3a9b9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:02.279222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:02.300052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:02.305207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 148/291] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:24:02 2022] PUT /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788/users/9a39cecaff0b428d9a0d4df8f6b4d0fd/roles/d799d50345d241e7a7b1a7e079d3a9b9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:24:02.333021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb90de-9bea-424e-93da-0e279f8772d9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:02.382547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:02.383538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:02.384010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:02.384428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:02.482689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:02.484665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:02.549566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:02.607593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 144/292] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:02.613761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:02.742252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7f048-c5d6-4336-a4af-a3f6618b7540 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:02.780870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda8a0a-3415-4aab-9a3d-2c424cb4f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:02.781790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda8a0a-3415-4aab-9a3d-2c424cb4f075 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:02.782216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda8a0a-3415-4aab-9a3d-2c424cb4f075 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:02.782640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda8a0a-3415-4aab-9a3d-2c424cb4f075 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:02.783978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda8a0a-3415-4aab-9a3d-2c424cb4f075 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:02.785597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda8a0a-3415-4aab-9a3d-2c424cb4f075 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:02.787489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 149/293] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:02 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:02.796009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:02.920553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bce951-e93a-4191-bc81-c8cc319ee079 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:02.955795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2d708-e29e-474c-9ad7-21ba6c9e5a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:02.956664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2d708-e29e-474c-9ad7-21ba6c9e5a04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:02.957090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2d708-e29e-474c-9ad7-21ba6c9e5a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:02.957504 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2d708-e29e-474c-9ad7-21ba6c9e5a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:02.958490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2d708-e29e-474c-9ad7-21ba6c9e5a04 None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=fc2f54a84e8141c080096289265d8c1e) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:02.958961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2d708-e29e-474c-9ad7-21ba6c9e5a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:02.960566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2d708-e29e-474c-9ad7-21ba6c9e5a04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:02.967545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 145/294] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:02 2022] GET /identity/v3/role_assignments?user.id=fc2f54a84e8141c080096289265d8c1e&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:03.494101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0ec93-0dee-4c4f-9277-b4bb329551c5 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.494454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0ec93-0dee-4c4f-9277-b4bb329551c5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.494648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0ec93-0dee-4c4f-9277-b4bb329551c5 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.496428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 150/295] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:03.501647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc95f3-a392-4168-9b0b-b43474b27558 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.501939 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc95f3-a392-4168-9b0b-b43474b27558 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.502212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc95f3-a392-4168-9b0b-b43474b27558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.523406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-64dc95f3-a392-4168-9b0b-b43474b27558 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:03.524597 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-64dc95f3-a392-4168-9b0b-b43474b27558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:03.543717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:03.595358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 146/296] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:03.618310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0ec93-0dee-4c4f-9277-b4bb329551c5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:03.687218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82524-bc47-4777-8e7c-3eb52420e8ef None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.688189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82524-bc47-4777-8e7c-3eb52420e8ef None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.688671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82524-bc47-4777-8e7c-3eb52420e8ef None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.690482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 147/297] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:03.695848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f8c9-fbfb-4012-abfd-e971614d6c85 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.696388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f8c9-fbfb-4012-abfd-e971614d6c85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.696883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f8c9-fbfb-4012-abfd-e971614d6c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.699457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:03.721318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f048f8c9-fbfb-4012-abfd-e971614d6c85 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:03.722485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f048f8c9-fbfb-4012-abfd-e971614d6c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:03.741968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0ec93-0dee-4c4f-9277-b4bb329551c5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:03.780399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:03.781066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.781302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.781573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.789419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 148/298] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:03.790794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1b02-bb02-43a9-9393-ba6263112130 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.791113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1b02-bb02-43a9-9393-ba6263112130 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.791383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1b02-bb02-43a9-9393-ba6263112130 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.793253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 149/299] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:03.800048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:03.800317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd674c10-2c40-4c9b-a6e2-b3db80b7c681 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.800694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd674c10-2c40-4c9b-a6e2-b3db80b7c681 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.801070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd674c10-2c40-4c9b-a6e2-b3db80b7c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:03.806055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:03.807150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:03.808204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:03.810660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 151/300] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:03.816556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:03.822609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bd674c10-2c40-4c9b-a6e2-b3db80b7c681 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:03.823851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bd674c10-2c40-4c9b-a6e2-b3db80b7c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:03.895539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 150/301] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:03.896282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd674c10-2c40-4c9b-a6e2-b3db80b7c681 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:03.912090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:03.944431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a2825-74f6-41c1-9c80-c7bef0ff4ffc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:03.972230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:03.981738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:03.982354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:03.982629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:03.983215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:03.983634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:03.983935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:03.985341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:03.998989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 152/302] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:03.998989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:04.006943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd674c10-2c40-4c9b-a6e2-b3db80b7c681 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.044246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.044884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.045161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.045430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.055561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:04.060696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:04.061585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:04.062418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 151/303] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:04.063702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:04.109258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475be14-5fe9-402e-b11b-a5ee104f9b42 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.140561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:04.143654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.144299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.144567 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.144841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.145969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:04.147442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:04.149027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 153/304] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:04.154565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:04.169227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77166f-7f3d-48c8-9518-d23d7c657719 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.209030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.209592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.209866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.210582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] PATH_INFO: `/v3/users/0c65ddba4f1741a9afaf4c2314192eda` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.211779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] RBAC: Authorizing `identity:get_user(user_id=0c65ddba4f1741a9afaf4c2314192eda)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:04.213248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:04.215846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 152/305] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:04 2022] GET /identity/v3/users/0c65ddba4f1741a9afaf4c2314192eda => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:04.216840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:04.220712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:04.267438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051951a-7f91-437a-b804-6343f23bd8d7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.302615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.303378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.303654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.303924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.304634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:04.305264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:04.306303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:04.319720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 154/306] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:04.319720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:04.333556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c702a4-6063-4c40-ba86-959980ca0c4d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.370140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.371884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.372174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.372451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] PATH_INFO: `/v3/groups` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.373128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:04.374575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:04.393350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 153/307] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Jul 31 18:24:04 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:04.405159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:04.409685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:04.450304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e85d-bb24-4f4e-a422-200559389999 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.476631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:04.494563 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.496418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.497130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.497646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] PATH_INFO: `/v3/system/users/0c65ddba4f1741a9afaf4c2314192eda/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.499684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0c65ddba4f1741a9afaf4c2314192eda, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:04.501379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:04.523321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 155/308] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Jul 31 18:24:04 2022] PUT /identity/v3/system/users/0c65ddba4f1741a9afaf4c2314192eda/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:04.547198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348fe4b-fe1a-4759-abfa-4e3100f03ffa None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.587577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be80229-6c30-4905-b84c-b7f085089266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.588251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80229-6c30-4905-b84c-b7f085089266 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.588528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80229-6c30-4905-b84c-b7f085089266 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.588805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80229-6c30-4905-b84c-b7f085089266 None admin] PATH_INFO: `/v3/users/3ff458101cc644e9b84db432bb93a716` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.605744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be80229-6c30-4905-b84c-b7f085089266 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff458101cc644e9b84db432bb93a716)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:04.607421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be80229-6c30-4905-b84c-b7f085089266 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:04.609478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 154/309] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:04 2022] GET /identity/v3/users/3ff458101cc644e9b84db432bb93a716 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:04.615796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:04.732541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c818-b9a4-489c-8772-27a659c195d0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:04.769043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636f590-1462-43a3-8166-9e482b3d7361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:04.769661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f590-1462-43a3-8166-9e482b3d7361 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.769988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f590-1462-43a3-8166-9e482b3d7361 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.770260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f590-1462-43a3-8166-9e482b3d7361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.771115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636f590-1462-43a3-8166-9e482b3d7361 None admin] RBAC: Adding query filter params (role.id=d799d50345d241e7a7b1a7e079d3a9b9, user.id=3ff458101cc644e9b84db432bb93a716, scope.system=all) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:04.771423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636f590-1462-43a3-8166-9e482b3d7361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:04.772930 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636f590-1462-43a3-8166-9e482b3d7361 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:04.779258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 156/310] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Jul 31 18:24:04 2022] GET /identity/v3/role_assignments?user.id=3ff458101cc644e9b84db432bb93a716&scope.system=all&role.id=d799d50345d241e7a7b1a7e079d3a9b9 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:04.798294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42bf0-a6bf-49c2-8e4e-b4d0371f38c2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.798810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42bf0-a6bf-49c2-8e4e-b4d0371f38c2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.798810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42bf0-a6bf-49c2-8e4e-b4d0371f38c2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.800572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 155/311] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:04.806364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290c3a-5e00-4528-9e38-bd49b12e7e92 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:04.806873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290c3a-5e00-4528-9e38-bd49b12e7e92 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:04.806976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290c3a-5e00-4528-9e38-bd49b12e7e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:04.827521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-54290c3a-5e00-4528-9e38-bd49b12e7e92 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:04.828735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-54290c3a-5e00-4528-9e38-bd49b12e7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:04.884283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:04.912684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 157/312] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:04.936580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb42bf0-a6bf-49c2-8e4e-b4d0371f38c2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:05.001745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:05.044876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb42bf0-a6bf-49c2-8e4e-b4d0371f38c2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:05.079934 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:05.080603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:05.080881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:05.081185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:05.092578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:05.097616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:05.098592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:05.099805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 156/313] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:05.105722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54290c3a-5e00-4528-9e38-bd49b12e7e92 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:05.211286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54290c3a-5e00-4528-9e38-bd49b12e7e92 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:05.252614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:05.253517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:05.253967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:05.254408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:05.255354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:05.255828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:05.257362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:05.267312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 158/314] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:05.273803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:05.378032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7454a6-cbfa-4072-b008-f2bcf808c6a1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:05.398329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:05.414229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:05.414878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:05.415245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:05.415527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] PATH_INFO: `/v3/users/9a39cecaff0b428d9a0d4df8f6b4d0fd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:05.416697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] RBAC: Authorizing `identity:get_user(user_id=9a39cecaff0b428d9a0d4df8f6b4d0fd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:05.418716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:05.420654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 157/315] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:05 2022] GET /identity/v3/users/9a39cecaff0b428d9a0d4df8f6b4d0fd => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:05.426259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:05.471499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:05.533204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18233222-915b-4935-8281-6c5c0c6249ed None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:05.568530 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:05.569437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:05.569895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:05.570415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:05.645280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:05.647089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:05.690454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:05.759421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 159/316] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:05.766370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:05.875083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc432f9-0351-4ab0-9ff0-7f49296cd41d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:05.913708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4ffdb-33c5-408f-882f-a90cb38c647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:05.914666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ffdb-33c5-408f-882f-a90cb38c647c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:05.915163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ffdb-33c5-408f-882f-a90cb38c647c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:05.915615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ffdb-33c5-408f-882f-a90cb38c647c None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:05.916992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4ffdb-33c5-408f-882f-a90cb38c647c None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:05.919082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4ffdb-33c5-408f-882f-a90cb38c647c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:05.921018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 158/317] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:05 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:05.926911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:06.030246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f20dc-49f4-4f7d-a525-ed090c7c177b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:06.065977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3242c-a1cd-4fc4-a182-8e81e6f27159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:06.066886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3242c-a1cd-4fc4-a182-8e81e6f27159 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.067371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3242c-a1cd-4fc4-a182-8e81e6f27159 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.067815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3242c-a1cd-4fc4-a182-8e81e6f27159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.068795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3242c-a1cd-4fc4-a182-8e81e6f27159 None admin] RBAC: Adding query filter params (role.id=d799d50345d241e7a7b1a7e079d3a9b9, scope.project.id=1802d8d1d6e34024a1209fbec590f788, user.id=9a39cecaff0b428d9a0d4df8f6b4d0fd) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:06.069281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3242c-a1cd-4fc4-a182-8e81e6f27159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:06.070919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3242c-a1cd-4fc4-a182-8e81e6f27159 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:06.077503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 160/318] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:05 2022] GET /identity/v3/role_assignments?user.id=9a39cecaff0b428d9a0d4df8f6b4d0fd&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=d799d50345d241e7a7b1a7e079d3a9b9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:06.633062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfc415-8e77-4654-89a4-c29d5e0161cb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.633325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfc415-8e77-4654-89a4-c29d5e0161cb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.633645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfc415-8e77-4654-89a4-c29d5e0161cb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.635143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 159/319] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:06.640511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125a37-7d74-48b2-b39e-281024e56551 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.640798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125a37-7d74-48b2-b39e-281024e56551 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.641073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125a37-7d74-48b2-b39e-281024e56551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.649340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:06.661513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-af125a37-7d74-48b2-b39e-281024e56551 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:06.662790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-af125a37-7d74-48b2-b39e-281024e56551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:06.664054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3167e-8fce-44ed-a813-7130f0d45cef None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.664339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3167e-8fce-44ed-a813-7130f0d45cef None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.664610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3167e-8fce-44ed-a813-7130f0d45cef None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.666523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 160/320] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:06.671824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64e5b-f6ca-40c6-9409-d3cb29ca557b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64e5b-f6ca-40c6-9409-d3cb29ca557b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.672389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64e5b-f6ca-40c6-9409-d3cb29ca557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.690786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-07e64e5b-f6ca-40c6-9409-d3cb29ca557b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:06.691948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-07e64e5b-f6ca-40c6-9409-d3cb29ca557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:06.741199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 161/321] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:06.744340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:06.762973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 161/322] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:06.764860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af125a37-7d74-48b2-b39e-281024e56551 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:06.785267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64e5b-f6ca-40c6-9409-d3cb29ca557b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:06.867722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af125a37-7d74-48b2-b39e-281024e56551 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:06.884640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64e5b-f6ca-40c6-9409-d3cb29ca557b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:06.901017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3502d-14a9-4168-a175-818b235810cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:06.902184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3502d-14a9-4168-a175-818b235810cd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.902458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3502d-14a9-4168-a175-818b235810cd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.902877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3502d-14a9-4168-a175-818b235810cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.904815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:06.913832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3502d-14a9-4168-a175-818b235810cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-54c3502d-14a9-4168-a175-818b235810cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:06.919379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:06.920337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:06.921162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:06.922347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc44e-4e62-4f94-977b-7db890a3f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:06.922347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc44e-4e62-4f94-977b-7db890a3f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.922347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc44e-4e62-4f94-977b-7db890a3f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.922551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 162/323] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:06.922620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc44e-4e62-4f94-977b-7db890a3f2d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.922686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a86a-dad1-4ce6-afe1-f01d7634bf92 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.922686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a86a-dad1-4ce6-afe1-f01d7634bf92 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.922686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a86a-dad1-4ce6-afe1-f01d7634bf92 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.922863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdc44e-4e62-4f94-977b-7db890a3f2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:06.923650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 163/324] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:06.923813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdc44e-4e62-4f94-977b-7db890a3f2d2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:06.930078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 162/325] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:06.930215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a86a-dad1-4ce6-afe1-f01d7634bf92 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:06.930635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8160-b11e-4bfa-a7f1-6eac418b9953 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:06.930635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8160-b11e-4bfa-a7f1-6eac418b9953 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:06.930635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8160-b11e-4bfa-a7f1-6eac418b9953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:06.947333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-feac8160-b11e-4bfa-a7f1-6eac418b9953 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:06.948472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-feac8160-b11e-4bfa-a7f1-6eac418b9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:06.997137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:07.014659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 163/326] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:07.015570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac8160-b11e-4bfa-a7f1-6eac418b9953 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:07.030536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a86a-dad1-4ce6-afe1-f01d7634bf92 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.064085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.064705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.064981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.065261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.065974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:07.066276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:07.067712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:07.076262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 164/327] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:07.076892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:07.118600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac8160-b11e-4bfa-a7f1-6eac418b9953 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.131655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:07.152372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.152996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.153273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.153543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] PATH_INFO: `/v3/groups` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.154205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:07.155682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:07.170267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 164/328] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Jul 31 18:24:07 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:07.171096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:07.177285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5cf5-262f-4659-ad5a-09377c782348 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.216115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.216695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.216976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.217248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.220636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:07.230793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:07.236560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:07.237553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:07.238399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 165/329] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:07.243958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:07.289824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bdf67-906e-4c19-99e0-072b2acbd107 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.333109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.334021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.334314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.334583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] PATH_INFO: `/v3/users/0c65ddba4f1741a9afaf4c2314192eda` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.335840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] RBAC: Authorizing `identity:get_user(user_id=0c65ddba4f1741a9afaf4c2314192eda)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:07.337590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:07.339978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 165/330] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:07 2022] GET /identity/v3/users/0c65ddba4f1741a9afaf4c2314192eda => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:07.346262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:07.366386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b8c1-aaad-4a5f-89af-6dad9f2c9aab None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.383772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:07.413203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.413767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.414051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.414316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.415752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:07.416066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:07.417720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:07.435030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 166/331] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:07.440885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:07.477998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c00a16-f7f2-4c6c-8e8d-6863b770227c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.497274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:07.524937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.525847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.526125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.526393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.527843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] RBAC: Adding query filter params (role.id=15b0048e55a3471595e2de48b01ecb84, user.id=0c65ddba4f1741a9afaf4c2314192eda, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:07.528149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:07.529671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:07.542949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 166/332] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Jul 31 18:24:07 2022] GET /identity/v3/role_assignments?user.id=0c65ddba4f1741a9afaf4c2314192eda&scope.system=all&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:07.552071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ff80-20db-43db-bfb8-8c0b4e4ffe1b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.597540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff145-20f5-4801-bab6-2e4577be7215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.598288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff145-20f5-4801-bab6-2e4577be7215 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.598562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff145-20f5-4801-bab6-2e4577be7215 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.598829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff145-20f5-4801-bab6-2e4577be7215 None admin] PATH_INFO: `/v3/users/3ff458101cc644e9b84db432bb93a716` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.600095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ff145-20f5-4801-bab6-2e4577be7215 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff458101cc644e9b84db432bb93a716)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:07.601625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ff145-20f5-4801-bab6-2e4577be7215 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:07.603681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 167/333] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:07 2022] GET /identity/v3/users/3ff458101cc644e9b84db432bb93a716 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:07.611161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:07.745547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa53a-203d-41ee-9466-b58700eee65d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:07.783376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f3c3-7b22-48ca-a235-5d8e88f574ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:07.783989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f3c3-7b22-48ca-a235-5d8e88f574ea None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:07.784270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f3c3-7b22-48ca-a235-5d8e88f574ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:07.784545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f3c3-7b22-48ca-a235-5d8e88f574ea None admin] PATH_INFO: `/v3/system/users/3ff458101cc644e9b84db432bb93a716/roles/d799d50345d241e7a7b1a7e079d3a9b9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:07.786085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f3c3-7b22-48ca-a235-5d8e88f574ea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ff458101cc644e9b84db432bb93a716, role_id=d799d50345d241e7a7b1a7e079d3a9b9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:07.787456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f3c3-7b22-48ca-a235-5d8e88f574ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:07.801748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 167/334] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Jul 31 18:24:07 2022] PUT /identity/v3/system/users/3ff458101cc644e9b84db432bb93a716/roles/d799d50345d241e7a7b1a7e079d3a9b9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:09.744562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7082-a89f-404f-b9c6-ae557d545756 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:09.745036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7082-a89f-404f-b9c6-ae557d545756 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:09.745036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7082-a89f-404f-b9c6-ae557d545756 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:09.747162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 168/335] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:09.752568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922422-59c4-4d90-bda2-d44f4d678c57 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:09.752964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922422-59c4-4d90-bda2-d44f4d678c57 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:09.753130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922422-59c4-4d90-bda2-d44f4d678c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:09.782971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-97922422-59c4-4d90-bda2-d44f4d678c57 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:09.788277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-97922422-59c4-4d90-bda2-d44f4d678c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:09.818619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:09.870816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 168/336] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:09.903615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a7082-a89f-404f-b9c6-ae557d545756 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:09.961507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:10.031246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a7082-a89f-404f-b9c6-ae557d545756 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:10.077042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5f489-6c32-4866-aa7c-19c299e8af24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:10.078178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f489-6c32-4866-aa7c-19c299e8af24 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.078636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f489-6c32-4866-aa7c-19c299e8af24 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.079113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f489-6c32-4866-aa7c-19c299e8af24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.100056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5f489-6c32-4866-aa7c-19c299e8af24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-39d5f489-6c32-4866-aa7c-19c299e8af24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:10.106526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:10.107706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:10.108520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:10.111879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 169/337] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:10.116943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922422-59c4-4d90-bda2-d44f4d678c57 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:10.223599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea8e0-473a-4fa7-8c38-5ece7531c4f1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.224140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea8e0-473a-4fa7-8c38-5ece7531c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.224569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea8e0-473a-4fa7-8c38-5ece7531c4f1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.226402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 170/338] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:10.232623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9496-0693-4e1f-938e-77f96f264042 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.232902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9496-0693-4e1f-938e-77f96f264042 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.233176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9496-0693-4e1f-938e-77f96f264042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.240735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922422-59c4-4d90-bda2-d44f4d678c57 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:10.275068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d24f9496-0693-4e1f-938e-77f96f264042 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:10.276271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d24f9496-0693-4e1f-938e-77f96f264042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:10.279231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:10.280035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.280486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.280900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.281812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:10.282265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:10.283934 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:10.294061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 169/339] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:10.299726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:10.335019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:10.423245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160828c1-c5de-48f2-b6db-e687d3322df1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:10.450671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 171/340] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:10.461623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4917d04-17df-46e6-a6b7-6680365157a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:10.462450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4917d04-17df-46e6-a6b7-6680365157a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.462876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4917d04-17df-46e6-a6b7-6680365157a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.463331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4917d04-17df-46e6-a6b7-6680365157a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.488869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9496-0693-4e1f-938e-77f96f264042 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:10.537236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4917d04-17df-46e6-a6b7-6680365157a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:10.539229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4917d04-17df-46e6-a6b7-6680365157a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:10.556101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:10.575343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:10.652585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 170/341] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 18:24:10.652783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9496-0693-4e1f-938e-77f96f264042 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:10.654518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcc6f-9211-4910-acce-44e73b49223d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.655906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcc6f-9211-4910-acce-44e73b49223d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.656337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcc6f-9211-4910-acce-44e73b49223d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.657906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 171/342] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:10.658790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffcc6f-9211-4910-acce-44e73b49223d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:10.719675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a18699-2bf2-4362-8486-29217f0acd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:10.720484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18699-2bf2-4362-8486-29217f0acd42 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.720603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18699-2bf2-4362-8486-29217f0acd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.720866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18699-2bf2-4362-8486-29217f0acd42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.736108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a18699-2bf2-4362-8486-29217f0acd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c6a18699-2bf2-4362-8486-29217f0acd42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:10.741072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:10.742138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:10.743112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:10.751369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 172/343] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:24:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:10.753406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ba68b-449e-4089-96f4-060afeb163c9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.753531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ba68b-449e-4089-96f4-060afeb163c9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.753779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ba68b-449e-4089-96f4-060afeb163c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.779789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffcc6f-9211-4910-acce-44e73b49223d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:10.784014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3c9ba68b-449e-4089-96f4-060afeb163c9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:10.785212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3c9ba68b-449e-4089-96f4-060afeb163c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:10.811386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:10.822283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:10.823228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.824421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.825083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.826422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:10.828152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:10.830061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 172/344] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:10 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:10.831097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:10.899807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 173/345] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:10.901244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89e61-ba90-4268-95eb-77698d7e6f5a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.901700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89e61-ba90-4268-95eb-77698d7e6f5a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.902115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89e61-ba90-4268-95eb-77698d7e6f5a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.904068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 174/346] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:10.904863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d89e61-ba90-4268-95eb-77698d7e6f5a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:10.939934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:10.950109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3fdc-da21-442e-a58c-5748ceb05f98 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:10.987131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d907e4-5e7a-46f6-8bc5-68ff99086bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:10.988031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d907e4-5e7a-46f6-8bc5-68ff99086bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:10.988455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d907e4-5e7a-46f6-8bc5-68ff99086bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:10.988871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d907e4-5e7a-46f6-8bc5-68ff99086bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:10.989836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d907e4-5e7a-46f6-8bc5-68ff99086bc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:10.990294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d907e4-5e7a-46f6-8bc5-68ff99086bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:10.992010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d907e4-5e7a-46f6-8bc5-68ff99086bc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:11.001461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 173/347] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:11.002998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43a34-7fb3-4d43-bb65-50aaedd997c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.003417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43a34-7fb3-4d43-bb65-50aaedd997c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.003816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43a34-7fb3-4d43-bb65-50aaedd997c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.023112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cac43a34-7fb3-4d43-bb65-50aaedd997c3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:11.024602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cac43a34-7fb3-4d43-bb65-50aaedd997c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:11.030549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d89e61-ba90-4268-95eb-77698d7e6f5a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:11.068529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:11.069650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.069770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.070126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.077006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:11.078875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:11.081067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 175/348] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:10 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:11.081675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:11.085972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.101737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 174/349] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:11.102924 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43a34-7fb3-4d43-bb65-50aaedd997c3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.211714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43a34-7fb3-4d43-bb65-50aaedd997c3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:11.218211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:11.230289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658a90-2cfd-46b5-987f-914ee339e93b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:11.254127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:11.254878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.255329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.255609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.269570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:11.270530 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.271031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.271483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.288558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:11.294436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:11.295452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:11.296418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:11.299078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 176/350] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:11.300093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.322734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:11.347273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:11.349044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:11.448339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71577768-43ba-4710-9840-1fd126ce4cd1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:11.490043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 175/351] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:11.490043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.503445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1610b0-7a3f-4ae5-8d84-a6c9569fd245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:11.504422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1610b0-7a3f-4ae5-8d84-a6c9569fd245 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.504913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1610b0-7a3f-4ae5-8d84-a6c9569fd245 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.505301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1610b0-7a3f-4ae5-8d84-a6c9569fd245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.506203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1610b0-7a3f-4ae5-8d84-a6c9569fd245 None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:11.506615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1610b0-7a3f-4ae5-8d84-a6c9569fd245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:11.508203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1610b0-7a3f-4ae5-8d84-a6c9569fd245 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:11.515764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 177/352] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:11.517005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72274-cb48-44e6-89d1-944e495f449a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.517292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72274-cb48-44e6-89d1-944e495f449a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.517568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72274-cb48-44e6-89d1-944e495f449a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.520616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 178/353] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:11.520616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b72274-cb48-44e6-89d1-944e495f449a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.545055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:11.603229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:11.623146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c770a1-0008-4a88-b19b-51d713fabc25 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:11.668907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b72274-cb48-44e6-89d1-944e495f449a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:11.669620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:11.670390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.670768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.671182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.684973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:11.690289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:11.691439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 18:24:11.692403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:11.693888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 176/354] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:11.694798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.717350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cd6d1-0f4b-48f2-a9ec-a9ea9b989b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:11.718570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd6d1-0f4b-48f2-a9ec-a9ea9b989b94 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.719085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd6d1-0f4b-48f2-a9ec-a9ea9b989b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.719815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd6d1-0f4b-48f2-a9ec-a9ea9b989b94 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.721168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cd6d1-0f4b-48f2-a9ec-a9ea9b989b94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:11.721654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cd6d1-0f4b-48f2-a9ec-a9ea9b989b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:11.723298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cd6d1-0f4b-48f2-a9ec-a9ea9b989b94 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:11.738976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 179/355] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:11.741268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853e9a0-6bcf-44a3-a88e-3d3752c406ec None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.741726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853e9a0-6bcf-44a3-a88e-3d3752c406ec None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.742171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853e9a0-6bcf-44a3-a88e-3d3752c406ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.776382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6853e9a0-6bcf-44a3-a88e-3d3752c406ec None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:11.778823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6853e9a0-6bcf-44a3-a88e-3d3752c406ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:11.842026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19013e-d83d-443c-8d84-67240ce30d5e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:11.863850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 180/356] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:11.865112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853e9a0-6bcf-44a3-a88e-3d3752c406ec None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.875079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:11.888167 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:11.889086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:11.889548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:11.889850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:11.891443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:11.892986 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:11.895640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 177/357] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:11.897373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:11.914739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:12.005541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853e9a0-6bcf-44a3-a88e-3d3752c406ec None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.031217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e137-8be4-4a34-b145-560fc0d23a4b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.048063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be4794-29d1-46ea-9bf3-abaca1fbc5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.048695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4794-29d1-46ea-9bf3-abaca1fbc5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.048970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4794-29d1-46ea-9bf3-abaca1fbc5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.049236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4794-29d1-46ea-9bf3-abaca1fbc5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.049979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4794-29d1-46ea-9bf3-abaca1fbc5d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:12.050242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4794-29d1-46ea-9bf3-abaca1fbc5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:12.051658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4794-29d1-46ea-9bf3-abaca1fbc5d6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:12.061353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 181/358] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:12.062491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c498e8e-9329-4293-90fe-8b1bf67572a6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.062691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c498e8e-9329-4293-90fe-8b1bf67572a6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.062961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c498e8e-9329-4293-90fe-8b1bf67572a6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.064596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 182/359] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:12.065341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c498e8e-9329-4293-90fe-8b1bf67572a6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.078655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc2978-76e9-4bfa-a65f-be303628160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.079302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2978-76e9-4bfa-a65f-be303628160d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.079973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2978-76e9-4bfa-a65f-be303628160d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.080257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2978-76e9-4bfa-a65f-be303628160d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.162424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:12.172009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc2978-76e9-4bfa-a65f-be303628160d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:12.173637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc2978-76e9-4bfa-a65f-be303628160d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:12.189991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:12.203461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c498e8e-9329-4293-90fe-8b1bf67572a6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.243057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.243879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.244259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.244634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.261412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:12.268286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:12.269392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:12.270396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:12.272393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 183/360] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:12.272969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.310004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 178/361] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:12.311300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3c232-a728-47fc-8ce3-5bc128d9f387 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.311584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3c232-a728-47fc-8ce3-5bc128d9f387 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.311852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3c232-a728-47fc-8ce3-5bc128d9f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.330697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-15e3c232-a728-47fc-8ce3-5bc128d9f387 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:12.331344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15e3c232-a728-47fc-8ce3-5bc128d9f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:12.409771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309e1a7-987b-4dc7-af07-420fe35fff9f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.425280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 179/362] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:12.427324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3c232-a728-47fc-8ce3-5bc128d9f387 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.447306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:12.463151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.463814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.464159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.464633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.466414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:12.467739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:12.469945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 184/363] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:12.470198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.487212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:12.557292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3c232-a728-47fc-8ce3-5bc128d9f387 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.601789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.602446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.602728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.605421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] PATH_INFO: `/v3/users/3ff458101cc644e9b84db432bb93a716` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.605421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff458101cc644e9b84db432bb93a716)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:12.605939 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:12.607967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 180/364] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/users/3ff458101cc644e9b84db432bb93a716 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:12.610550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.615167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602748-d586-45fb-b256-928cbf025702 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.663193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.663870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.664155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.664430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.665155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:12.665459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:12.666835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:12.676245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 185/365] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:12.676987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.733243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c9d42-26ac-4897-8936-631e0f7ecbc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.746022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:12.755525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:12.785791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.787614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.787614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.787614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.789400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:12.790906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:12.793089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 181/366] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:12.793743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.803067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458ac40-8305-445b-a170-081b958c12e8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.845610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.846286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.846568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.846838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.859775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:12.865225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:12.866107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 186/367] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:12.866927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.923974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33aab0-0bc9-4273-bb7d-2afa062b93a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:12.968687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:12.969236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:12.969514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:12.969794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:12.970572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:12.970879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:12.972340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:12.987411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 182/368] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:12.988235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:12.992417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439c6df-6197-46df-887f-4ac2e11aafc6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.012786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.040206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.040859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.041133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.041405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.042905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] RBAC: Adding query filter params (role.id=d799d50345d241e7a7b1a7e079d3a9b9, user.id=3ff458101cc644e9b84db432bb93a716, scope.system=all) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:13.044253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.045815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.067316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 187/369] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/role_assignments?user.id=3ff458101cc644e9b84db432bb93a716&scope.system=all&role.id=d799d50345d241e7a7b1a7e079d3a9b9 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:13.068093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:13.073160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.157281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659b4b-792d-4312-95c7-002f15dd7d66 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.207634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.208284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.208563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.208837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.243588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f289dfd-7dca-47e7-b128-1fe7a3adeec4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.294526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.295609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.296096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.296638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.298289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.300343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.302640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 188/370] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:13 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:13.303710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:13.319407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.321176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.366363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.387021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.443773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bd037-989d-4deb-a5cb-752e9cccdec4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.460563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 183/371] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:13.461272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:13.493966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.494995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.496152 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.496889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.497827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:13.498531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.500272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.510255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 189/372] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:13.511600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:13.594458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3560-2729-4e23-867c-4d190a939291 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.637454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.638282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a57fd-f56b-47e7-81e4-f9884e4b053d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.638741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.639530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.640063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.641056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=1802d8d1d6e34024a1209fbec590f788) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:13.641572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.643268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.646164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.650556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 184/373] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:13 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:13.652850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:13.668353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.691183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.691846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.692122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.692394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.693683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.695160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.697146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 190/374] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:13 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:13.702772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:13.781947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3da3-f5b8-45e0-b3d1-544938ea8159 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.814063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ffea2-7eb4-429f-8137-65e8f600648c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:13.821772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.822699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.823167 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.824147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.852477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:13.853296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:13.853665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:13.854039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:13.856124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.857801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.859565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 191/375] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:13 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:13.866198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:13.904037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:13.905862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:13.914558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.919364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:13.977087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45872-5546-42af-8dd5-d743215c763f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:14.014681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50957d-46e0-4aaa-8901-6456a96d352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:14.015647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50957d-46e0-4aaa-8901-6456a96d352a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.016278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50957d-46e0-4aaa-8901-6456a96d352a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.016278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50957d-46e0-4aaa-8901-6456a96d352a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.017255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50957d-46e0-4aaa-8901-6456a96d352a None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=1802d8d1d6e34024a1209fbec590f788) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:14.017637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50957d-46e0-4aaa-8901-6456a96d352a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:14.019172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50957d-46e0-4aaa-8901-6456a96d352a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:14.024150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 185/376] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:14.026330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 192/377] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:13 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:14.030477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:14.100007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b3df-5a12-4e2d-8ea6-e5118689fde4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.100307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b3df-5a12-4e2d-8ea6-e5118689fde4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.100476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b3df-5a12-4e2d-8ea6-e5118689fde4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.102172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 193/378] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:14.108415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687ce8-9011-4eae-bf31-8ccc00b059ef None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.108710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687ce8-9011-4eae-bf31-8ccc00b059ef None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.108964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687ce8-9011-4eae-bf31-8ccc00b059ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.144051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-26687ce8-9011-4eae-bf31-8ccc00b059ef None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:14.145265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-26687ce8-9011-4eae-bf31-8ccc00b059ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:14.152952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a53e8-9da8-4f3c-b1ee-eeffb7c48d1e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:14.163604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:14.194274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:14.195363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.195920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.196397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] PATH_INFO: `/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.198071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ea2a81ace4d57afbbf4c3099ddcb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:14.199951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:14.202295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 186/379] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:14 2022] GET /identity/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:14.207621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:14.294918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 194/380] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:14.326836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687ce8-9011-4eae-bf31-8ccc00b059ef None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:14.337148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150066e-9695-4360-b044-c51f5e1b4a95 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:14.374434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:14.377950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:14.378781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.379248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.379682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] PATH_INFO: `/v3/groups/4b191454c3f24136b0c464b308eba70a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.389326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] RBAC: Authorizing `identity:get_group(group_id=4b191454c3f24136b0c464b308eba70a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:14.391158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:14.393433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 187/381] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:14 2022] GET /identity/v3/groups/4b191454c3f24136b0c464b308eba70a => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:14.399444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:14.458703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:14.462767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687ce8-9011-4eae-bf31-8ccc00b059ef None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:14.508075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:14.508699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.509071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.510549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.523181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:14.529181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:14.530293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:14.531334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:14.537998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 195/382] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:14.539667 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:14.550172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082482c-9b8b-41fa-ba43-39ba1921a7f1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:14.595933 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:14.597045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.597468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.597907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.599529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] RBAC: Adding query filter params (group.id=4b191454c3f24136b0c464b308eba70a, role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=d68ea2a81ace4d57afbbf4c3099ddcb7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:14.599987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:14.602170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:14.615372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 188/383] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:14 2022] GET /identity/v3/role_assignments?group.id=4b191454c3f24136b0c464b308eba70a&scope.project.id=d68ea2a81ace4d57afbbf4c3099ddcb7&role.id=2f18a54954a047398aca6b1a7389586b => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:14.686508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:14.698144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066d99a-c7a2-4de1-a354-7a0ac530d321 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:14.737394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:14.738284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.738705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.739182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.740081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:14.740528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:14.742073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:14.752531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 196/384] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:14.758583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:14.868961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eece900-bd3b-44e5-89a4-0e0694a4d66c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:14.872419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:14.905912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:14.906579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:14.906856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:14.907163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:14.908371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:14.909842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:14.915039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 189/385] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:14 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:14.917564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:15.022677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f3861-b95d-42c7-a085-c60183ddd583 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:15.058733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c859f4-39b2-4666-a29b-7b4ca468fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:15.059407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c859f4-39b2-4666-a29b-7b4ca468fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:15.059682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c859f4-39b2-4666-a29b-7b4ca468fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:15.059950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c859f4-39b2-4666-a29b-7b4ca468fe64 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:15.061127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c859f4-39b2-4666-a29b-7b4ca468fe64 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:15.062566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c859f4-39b2-4666-a29b-7b4ca468fe64 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:15.068942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 197/386] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:14 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:15.070284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:15.175099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8999-4c2f-4ea8-a0f0-7576c248d862 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:15.210330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df21ca-2cc5-470d-88fd-20d659afa2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:15.211054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df21ca-2cc5-470d-88fd-20d659afa2ee None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:15.211336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df21ca-2cc5-470d-88fd-20d659afa2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:15.211604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df21ca-2cc5-470d-88fd-20d659afa2ee None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/groups/fe425f6b2fc54d01ab025968497d6e94/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:15.213610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df21ca-2cc5-470d-88fd-20d659afa2ee None admin] RBAC: Authorizing `identity:create_grant(project_id=a64c237ef8714ed3a5e65ad1aaace7ff, group_id=fe425f6b2fc54d01ab025968497d6e94, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:15.215262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df21ca-2cc5-470d-88fd-20d659afa2ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:15.235080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 190/387] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Jul 31 18:24:15 2022] PUT /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/groups/fe425f6b2fc54d01ab025968497d6e94/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:15.872855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defdc82-0fde-47b4-ae0e-e91e31aa80ba None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:15.873122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defdc82-0fde-47b4-ae0e-e91e31aa80ba None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:15.873389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defdc82-0fde-47b4-ae0e-e91e31aa80ba None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:15.875003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 198/388] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:15.880572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeb6dc-83dd-42c9-a5cc-e45f8dd0f366 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:15.880863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeb6dc-83dd-42c9-a5cc-e45f8dd0f366 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:15.881136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeb6dc-83dd-42c9-a5cc-e45f8dd0f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:15.901920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-badeb6dc-83dd-42c9-a5cc-e45f8dd0f366 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:15.903144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-badeb6dc-83dd-42c9-a5cc-e45f8dd0f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:15.930842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:15.975187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 191/389] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:16.007339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defdc82-0fde-47b4-ae0e-e91e31aa80ba None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:16.041027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:16.143933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defdc82-0fde-47b4-ae0e-e91e31aa80ba None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:16.188215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287179cb-6b46-40ca-af5b-5b6dee30aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:16.188874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287179cb-6b46-40ca-af5b-5b6dee30aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.189159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287179cb-6b46-40ca-af5b-5b6dee30aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.189435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287179cb-6b46-40ca-af5b-5b6dee30aeb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.205148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287179cb-6b46-40ca-af5b-5b6dee30aeb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-287179cb-6b46-40ca-af5b-5b6dee30aeb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:16.210496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:16.211458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:16.212301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 199/390] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:24:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:16.219834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeb6dc-83dd-42c9-a5cc-e45f8dd0f366 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:16.283019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5caa1-1687-46df-a8dc-83ef7a619d66 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.283373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5caa1-1687-46df-a8dc-83ef7a619d66 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.286956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5caa1-1687-46df-a8dc-83ef7a619d66 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.286956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 200/391] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:16.290407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091fe81-29b2-4036-b5ae-c75564d9327a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.290698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091fe81-29b2-4036-b5ae-c75564d9327a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.291007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091fe81-29b2-4036-b5ae-c75564d9327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.310375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1091fe81-29b2-4036-b5ae-c75564d9327a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:16.311611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1091fe81-29b2-4036-b5ae-c75564d9327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:16.379548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeb6dc-83dd-42c9-a5cc-e45f8dd0f366 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:16.419982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 201/392] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:16.444829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091fe81-29b2-4036-b5ae-c75564d9327a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:16.467341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:16.467699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:16.468762 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.469047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.469323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.470051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:16.470480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:16.474734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:16.492687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 192/393] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:16.499299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:16.542179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:16.624015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5246b0-237f-4df2-b614-4addc45d3a80 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:16.657686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091fe81-29b2-4036-b5ae-c75564d9327a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:16.661001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:16.661974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.662403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.662831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.664197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:16.665790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:16.667698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 193/394] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:16 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:16.676135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:16.737194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:16.737850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.738126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.738406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.756644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:16.765916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:16.766854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:16.767701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:16.768800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 202/395] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:24:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:16.775954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:16.822227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:16.832626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b02178-6091-4a15-a862-3bcbe806ff00 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:16.872775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:16.878248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8d7a9-f5ca-4b09-b3f3-c8cc604e0af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:16.878901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8d7a9-f5ca-4b09-b3f3-c8cc604e0af7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.879209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8d7a9-f5ca-4b09-b3f3-c8cc604e0af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.879482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8d7a9-f5ca-4b09-b3f3-c8cc604e0af7 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.881369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8d7a9-f5ca-4b09-b3f3-c8cc604e0af7 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:16.882826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8d7a9-f5ca-4b09-b3f3-c8cc604e0af7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:16.888135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 194/396] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:16 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:16.888135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd663f8-e6e3-4b95-a35b-db8f18f81b65 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.888135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd663f8-e6e3-4b95-a35b-db8f18f81b65 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.888135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd663f8-e6e3-4b95-a35b-db8f18f81b65 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.888135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 195/397] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:16.897851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd663f8-e6e3-4b95-a35b-db8f18f81b65 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:16.910377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b913d2-1ca7-4b1a-83b6-3f319d3464c5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:16.945428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fe302-adc8-41da-bbcb-81b6399cbd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:16.945969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe302-adc8-41da-bbcb-81b6399cbd12 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.946243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe302-adc8-41da-bbcb-81b6399cbd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.946505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe302-adc8-41da-bbcb-81b6399cbd12 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.947242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fe302-adc8-41da-bbcb-81b6399cbd12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:16.947540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fe302-adc8-41da-bbcb-81b6399cbd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:16.949439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fe302-adc8-41da-bbcb-81b6399cbd12 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:16.957912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 203/398] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:16.959024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b5ec3-e612-438e-b327-07846f61da74 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:16.959306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b5ec3-e612-438e-b327-07846f61da74 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:16.959574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b5ec3-e612-438e-b327-07846f61da74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:16.977876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-807b5ec3-e612-438e-b327-07846f61da74 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:16.979090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-807b5ec3-e612-438e-b327-07846f61da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:17.035220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd663f8-e6e3-4b95-a35b-db8f18f81b65 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.070061 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 204/399] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:17.070061 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b5ec3-e612-438e-b327-07846f61da74 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.082792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.084629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.084948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.085227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/groups/fe425f6b2fc54d01ab025968497d6e94/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.091503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a64c237ef8714ed3a5e65ad1aaace7ff, group_id=fe425f6b2fc54d01ab025968497d6e94, role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:17.093954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:17.113682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 196/400] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Jul 31 18:24:16 2022] PUT /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff/groups/fe425f6b2fc54d01ab025968497d6e94/roles/3995ac4c39964acab5ea20561b89faf8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:17.113682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.137382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:17.201917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:17.244368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72dec-00ea-4036-923e-05456341f1a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.279604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b5ec3-e612-438e-b327-07846f61da74 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.285054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.285779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.286116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.286394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.300295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:17.306554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:17.308140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:17.309624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 197/401] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:17.315143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.346526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a529e-4ef1-4039-bbe5-bb72a8fad877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.347494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a529e-4ef1-4039-bbe5-bb72a8fad877 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.347774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a529e-4ef1-4039-bbe5-bb72a8fad877 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.348048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a529e-4ef1-4039-bbe5-bb72a8fad877 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.350080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a529e-4ef1-4039-bbe5-bb72a8fad877 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:17.352193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a529e-4ef1-4039-bbe5-bb72a8fad877 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:17.355432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 205/402] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:17.357272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf7c3-3fc8-4cde-90b7-5f72886e4143 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.357757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf7c3-3fc8-4cde-90b7-5f72886e4143 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.358154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf7c3-3fc8-4cde-90b7-5f72886e4143 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.359989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 206/403] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:17.360968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf7c3-3fc8-4cde-90b7-5f72886e4143 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.426011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:17.459760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904b7d-e530-4f90-a762-0131550bd4a4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.487459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf7c3-3fc8-4cde-90b7-5f72886e4143 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.509728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ed1a4-a8ed-4fa1-8eb9-5c190eb5c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.511594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed1a4-a8ed-4fa1-8eb9-5c190eb5c410 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.511929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed1a4-a8ed-4fa1-8eb9-5c190eb5c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.512648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed1a4-a8ed-4fa1-8eb9-5c190eb5c410 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.513377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ed1a4-a8ed-4fa1-8eb9-5c190eb5c410 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:17.514193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ed1a4-a8ed-4fa1-8eb9-5c190eb5c410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:17.516346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ed1a4-a8ed-4fa1-8eb9-5c190eb5c410 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:17.525660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.526473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.526814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.526950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 198/404] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:17.527391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.528419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15290d-b64a-4f9d-86ca-0c322b2a2b31 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.528698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15290d-b64a-4f9d-86ca-0c322b2a2b31 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.528977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15290d-b64a-4f9d-86ca-0c322b2a2b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.533270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:17.534883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:17.537114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 207/405] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:17.537947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.543068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:17.554438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3d15290d-b64a-4f9d-86ca-0c322b2a2b31 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:17.555996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d15290d-b64a-4f9d-86ca-0c322b2a2b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:17.649011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 199/406] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:17.654460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15290d-b64a-4f9d-86ca-0c322b2a2b31 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.658283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615de1c-fc68-4858-8d91-7cd881a1a8a1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.707645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.708320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.708594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.708862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.710120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:17.711613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:17.718575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 208/407] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:17.719409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.753923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:17.787271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15290d-b64a-4f9d-86ca-0c322b2a2b31 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.799862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:17.825580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.826261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.826544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.826819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788/groups/fe425f6b2fc54d01ab025968497d6e94/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.829070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] RBAC: Authorizing `identity:create_grant(project_id=1802d8d1d6e34024a1209fbec590f788, group_id=fe425f6b2fc54d01ab025968497d6e94, role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:17.829887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c4d8-2e32-4bec-a0f7-e9768c2ad295 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:17.830522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:17.855030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 200/408] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Jul 31 18:24:17 2022] PUT /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788/groups/fe425f6b2fc54d01ab025968497d6e94/roles/3995ac4c39964acab5ea20561b89faf8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:17.855030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.881908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be530da-d718-4896-901b-9c11b8f72a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:17.882715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be530da-d718-4896-901b-9c11b8f72a8a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.883104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be530da-d718-4896-901b-9c11b8f72a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.883444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be530da-d718-4896-901b-9c11b8f72a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.897635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be530da-d718-4896-901b-9c11b8f72a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1be530da-d718-4896-901b-9c11b8f72a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:17.903229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:17.904229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:17.905031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:17.909671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 209/409] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:17.911149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764b01-ebd0-40b6-b87b-57bed95d3392 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:17.911501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764b01-ebd0-40b6-b87b-57bed95d3392 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:17.911840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764b01-ebd0-40b6-b87b-57bed95d3392 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:17.913542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 210/410] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:17.914172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764b01-ebd0-40b6-b87b-57bed95d3392 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:17.990899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255d5e-7964-4409-b210-5f171a308c98 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.027862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:18.035987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641facf-92f1-4443-8ad7-fed9946bbdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.035987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641facf-92f1-4443-8ad7-fed9946bbdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.035987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641facf-92f1-4443-8ad7-fed9946bbdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.036510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641facf-92f1-4443-8ad7-fed9946bbdb7 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.038058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641facf-92f1-4443-8ad7-fed9946bbdb7 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:18.040324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641facf-92f1-4443-8ad7-fed9946bbdb7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:18.043465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 201/411] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:18.045061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b9a4-3304-4363-b650-1e5cb8ae3980 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.045566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b9a4-3304-4363-b650-1e5cb8ae3980 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.046040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b9a4-3304-4363-b650-1e5cb8ae3980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.071486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1ed8b9a4-3304-4363-b650-1e5cb8ae3980 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:18.072667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ed8b9a4-3304-4363-b650-1e5cb8ae3980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:18.085743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764b01-ebd0-40b6-b87b-57bed95d3392 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.128221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.128848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.129134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.129402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.130122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:18.130430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:18.132432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:18.136011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:18.144852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 211/412] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:18.146062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 202/413] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:18.150110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:18.151100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b9a4-3304-4363-b650-1e5cb8ae3980 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:18.273651 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a38f-86c2-443e-a895-31b982eed9be None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.286860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b9a4-3304-4363-b650-1e5cb8ae3980 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.311179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.311993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.312374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.312751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788/groups/fe425f6b2fc54d01ab025968497d6e94/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.314855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] RBAC: Authorizing `identity:create_grant(project_id=1802d8d1d6e34024a1209fbec590f788, group_id=fe425f6b2fc54d01ab025968497d6e94, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:18.316474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:18.321860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:18.330249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.331245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.331673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.332186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] PATH_INFO: `/v3/groups/4b191454c3f24136b0c464b308eba70a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.333586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] RBAC: Authorizing `identity:get_group(group_id=4b191454c3f24136b0c464b308eba70a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:18.333743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 212/414] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Jul 31 18:24:18 2022] PUT /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788/groups/fe425f6b2fc54d01ab025968497d6e94/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:18.334648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:18.335669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:18.338207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 203/415] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:18 2022] GET /identity/v3/groups/4b191454c3f24136b0c464b308eba70a => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:18.344048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:18.408576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:18.485073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a378b-0c7b-44f6-8a1f-8e197cb75552 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.506612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ab64b-c890-4487-93ab-0ea70f5f81e8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.552559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.553812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.554304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.554796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] PATH_INFO: `/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.556247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ea2a81ace4d57afbbf4c3099ddcb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:18.558090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:18.560860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 204/416] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:18 2022] GET /identity/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:18.566514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:18.583150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.584270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.584610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.584948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.597251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:18.603741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:18.605373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:18.606400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 213/417] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:18.611550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:18.656198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:18.730458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da3b3-537a-4f78-8ff3-62db306afdc0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.730961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898ca1-3051-4f71-8b0e-bb1fabe99e38 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.749894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:18.770283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.771296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.772488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.772974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.773920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:18.774426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:18.776124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:18.786336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 214/418] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:18.795940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:18.819769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.820390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.820681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.820966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] PATH_INFO: `/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7/groups/4b191454c3f24136b0c464b308eba70a/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:18.823008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] RBAC: Authorizing `identity:create_grant(project_id=d68ea2a81ace4d57afbbf4c3099ddcb7, group_id=4b191454c3f24136b0c464b308eba70a, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:18.824878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:18.854066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 205/419] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Jul 31 18:24:18 2022] PUT /identity/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7/groups/4b191454c3f24136b0c464b308eba70a/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:24:18.931806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ed7b-aac9-47c4-a606-cb846b37daa4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:18.969027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:18.969840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:18.970232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:18.970614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:19.045629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:19.049582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:19.051139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:19.170601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 215/420] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:19.176006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:19.290126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113dd35-ac60-4750-8e3c-d440827188df None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:19.321007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:19.333750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ef043-4b06-4382-a2a7-36013f513fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:19.334419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef043-4b06-4382-a2a7-36013f513fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:19.335078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef043-4b06-4382-a2a7-36013f513fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:19.335620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef043-4b06-4382-a2a7-36013f513fd1 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:19.337370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ef043-4b06-4382-a2a7-36013f513fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:19.339409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ef043-4b06-4382-a2a7-36013f513fd1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:19.343091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 206/421] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:19 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:19.347770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:19.363490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd12c7-3acc-4c47-b4c2-2e3daacc24f6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:19.363490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd12c7-3acc-4c47-b4c2-2e3daacc24f6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:19.363490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd12c7-3acc-4c47-b4c2-2e3daacc24f6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:19.363490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 207/422] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:19.363855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c816-2efa-431b-bd11-1fa755c13cdb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:19.364117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c816-2efa-431b-bd11-1fa755c13cdb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:19.364373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c816-2efa-431b-bd11-1fa755c13cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:19.403945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4799c816-2efa-431b-bd11-1fa755c13cdb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:19.405278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4799c816-2efa-431b-bd11-1fa755c13cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:19.442012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:19.492634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca24bc-7a1c-4b5b-a70f-08ec8967f5a5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:19.537459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:19.538168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:19.538452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:19.538727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:19.539910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:19.541348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:19.543589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 216/423] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:19 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:19.549465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:19.550983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 208/424] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:19.642676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799c816-2efa-431b-bd11-1fa755c13cdb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:19.675298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa47008-635c-4387-a351-9d635dd4734d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:19.711086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:19.711631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:19.711910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:19.712180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:19.712968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:19.713277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:19.714753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:19.727092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 217/425] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:19 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:19.785992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799c816-2efa-431b-bd11-1fa755c13cdb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:19.814709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:19.833700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:19.834418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:19.834745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:19.835042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:19.850705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:19.856809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:19.857791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:19.858589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 209/426] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:24:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:19.868084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:19.886431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:19.987650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841fa77-5acd-423d-8677-b2eae8aaaf8f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:20.023982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25e92-d4be-42c2-a155-b94b2e5dca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:20.024604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25e92-d4be-42c2-a155-b94b2e5dca4c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.024935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25e92-d4be-42c2-a155-b94b2e5dca4c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.025211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25e92-d4be-42c2-a155-b94b2e5dca4c None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.025929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25e92-d4be-42c2-a155-b94b2e5dca4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:20.026329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25e92-d4be-42c2-a155-b94b2e5dca4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:20.027750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25e92-d4be-42c2-a155-b94b2e5dca4c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:20.036501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 218/427] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:20.044756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:20.154536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4be90-8840-4e34-8d91-585915ec3c33 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:20.189786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:20.190413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.190699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.190994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.244828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:20.262289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:20.264251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:20.328034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecae766-c50e-4db4-9764-c4535de7f8a1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.328706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecae766-c50e-4db4-9764-c4535de7f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.328706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecae766-c50e-4db4-9764-c4535de7f8a1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.331041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 219/428] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:20.336211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3b414-3318-4b67-af70-b7b0b5ab3afa None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.336627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3b414-3318-4b67-af70-b7b0b5ab3afa None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.336908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3b414-3318-4b67-af70-b7b0b5ab3afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.361688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-64a3b414-3318-4b67-af70-b7b0b5ab3afa None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:20.363246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-64a3b414-3318-4b67-af70-b7b0b5ab3afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:20.387523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 210/429] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:20.390578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:20.460723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:20.470638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 220/430] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:20.494086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3b414-3318-4b67-af70-b7b0b5ab3afa None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:20.505571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:20.526847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d924b8-4ce6-498b-92a8-dec59cfa5bb4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:20.565920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:20.566984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.567711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.568199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] PATH_INFO: `/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.570354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c237ef8714ed3a5e65ad1aaace7ff)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:20.573778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:20.576020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 211/431] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:20 2022] GET /identity/v3/projects/a64c237ef8714ed3a5e65ad1aaace7ff => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:20.581520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:20.619188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3b414-3318-4b67-af70-b7b0b5ab3afa None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:20.657888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:20.658541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.658819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.659144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.670979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:20.677104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:20.678032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:20.678859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:20.681976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 221/432] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:24:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:20.684889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:20.723070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b41c5-790d-4eac-b9b1-70f868693925 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:20.763758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:20.764593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.764869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.765139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.766365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:20.766993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:20.768846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:20.770847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 212/433] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:20 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:20.776221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:20.800824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:20.816422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db5d9-725c-49d6-b811-a3b8a2395dd8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:20.863443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d795-89db-429f-b378-347144aaa77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:20.864358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d795-89db-429f-b378-347144aaa77a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.864779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d795-89db-429f-b378-347144aaa77a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.865190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d795-89db-429f-b378-347144aaa77a None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.866049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797d795-89db-429f-b378-347144aaa77a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:20.866495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797d795-89db-429f-b378-347144aaa77a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:20.868125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797d795-89db-429f-b378-347144aaa77a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:20.881584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 222/434] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:20.887299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d795-89db-429f-b378-347144aaa77a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:20.907582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aac44-ed9a-45f2-a202-2e90fd5eef88 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:20.953769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82674a3f-a8af-4032-9e2e-3e0a3c8ed0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:20.954981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674a3f-a8af-4032-9e2e-3e0a3c8ed0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.955811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674a3f-a8af-4032-9e2e-3e0a3c8ed0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.956261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674a3f-a8af-4032-9e2e-3e0a3c8ed0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.957457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82674a3f-a8af-4032-9e2e-3e0a3c8ed0d5 None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:20.957938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82674a3f-a8af-4032-9e2e-3e0a3c8ed0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:20.959876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82674a3f-a8af-4032-9e2e-3e0a3c8ed0d5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:20.974978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 213/435] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:20 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=a64c237ef8714ed3a5e65ad1aaace7ff&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:20.974978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525334-0424-4d42-8d56-7323d48e7416 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.974978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525334-0424-4d42-8d56-7323d48e7416 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.974978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525334-0424-4d42-8d56-7323d48e7416 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.974978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 214/436] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:20.977159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6d2f-3ef9-4031-88a8-7dfa2cad1ab1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:20.977460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6d2f-3ef9-4031-88a8-7dfa2cad1ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:20.977721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6d2f-3ef9-4031-88a8-7dfa2cad1ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:20.997560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e57b6d2f-3ef9-4031-88a8-7dfa2cad1ab1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:20.998814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e57b6d2f-3ef9-4031-88a8-7dfa2cad1ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:21.006379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d795-89db-429f-b378-347144aaa77a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.038186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.056042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.056928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.057210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.058701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.081357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 215/437] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:21.105675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b6d2f-3ef9-4031-88a8-7dfa2cad1ab1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.124985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.165987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:21.167219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:21.244965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b6d2f-3ef9-4031-88a8-7dfa2cad1ab1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.288845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.290524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.291091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.291572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.294988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 223/438] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 18:24:21.300618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.308520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:21.314728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:21.315683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:21.316502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 216/439] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:21.322780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.334726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.424866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.443685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b3003-b7cc-4679-b791-0e15d9771b02 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.459505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26afe5-f230-40b7-be38-cdf9847f5a84 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.480040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3f9eb-3281-4b26-a609-cb85a2f2f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.480826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3f9eb-3281-4b26-a609-cb85a2f2f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.481102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3f9eb-3281-4b26-a609-cb85a2f2f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.481371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3f9eb-3281-4b26-a609-cb85a2f2f9e4 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.482512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3f9eb-3281-4b26-a609-cb85a2f2f9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:21.484004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3f9eb-3281-4b26-a609-cb85a2f2f9e4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:21.485639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 224/440] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:21.486731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264a1b-d367-4bec-b461-9f99aa945938 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.487037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264a1b-d367-4bec-b461-9f99aa945938 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.487313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264a1b-d367-4bec-b461-9f99aa945938 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.488653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 225/441] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:21.491074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73264a1b-d367-4bec-b461-9f99aa945938 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.494134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7dfc3-629a-4053-81ca-70a5f7e5a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.496288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7dfc3-629a-4053-81ca-70a5f7e5a54a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.496568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7dfc3-629a-4053-81ca-70a5f7e5a54a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.496837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7dfc3-629a-4053-81ca-70a5f7e5a54a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.497606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7dfc3-629a-4053-81ca-70a5f7e5a54a None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:21.497910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7dfc3-629a-4053-81ca-70a5f7e5a54a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:21.499301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7dfc3-629a-4053-81ca-70a5f7e5a54a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:21.507448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 217/442] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:21.507448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ec6f-bc89-4288-995a-8eb68f702ab8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.507448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ec6f-bc89-4288-995a-8eb68f702ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.507448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ec6f-bc89-4288-995a-8eb68f702ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.526759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3b69ec6f-bc89-4288-995a-8eb68f702ab8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:21.527992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3b69ec6f-bc89-4288-995a-8eb68f702ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:21.583543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.593264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 218/443] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:21.594097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69ec6f-bc89-4288-995a-8eb68f702ab8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.595339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73264a1b-d367-4bec-b461-9f99aa945938 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.631433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.632070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.632350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.632623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.633760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:21.635236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:21.639512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 226/444] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:21.639512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.668237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.701572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69ec6f-bc89-4288-995a-8eb68f702ab8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.735251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.735876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.736152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.736432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.738334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549be9e-3fb0-4cba-9039-fe88267258e5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.772047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.772676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.772957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.773230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.783260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:21.788058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:21.789179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 227/445] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:21.790206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.806021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:21.808269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:21.812632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.871946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:21.892227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead1ee-a958-4d08-9476-8d5148536730 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:21.907767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 219/446] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:21.908718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:21.927143 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:21.927760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:21.928049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:21.928316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:21.929099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=1802d8d1d6e34024a1209fbec590f788) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:21.929412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:21.930859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:21.937300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 228/447] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:21.943858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:22.019072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98b8a1-c65f-4f28-ba15-99d38f3bdea6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.044038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:22.056593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.057235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.058278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.058548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.059317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:22.059625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.061043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.065931 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0a1b6-398e-40c6-81a7-f4ef6f683ba6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.071170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 220/448] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:22.076865 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:22.106498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.107687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.107687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.108199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] PATH_INFO: `/v3/projects/1802d8d1d6e34024a1209fbec590f788` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.110162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] RBAC: Authorizing `identity:get_project(project_id=1802d8d1d6e34024a1209fbec590f788)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.110863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:22.111306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.113770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 229/449] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:21 2022] GET /identity/v3/projects/1802d8d1d6e34024a1209fbec590f788 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:22.119705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:22.192964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efa3e2-a3be-4f66-bec5-860c379d91ce None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.225197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7899-47f0-429a-b459-9fc2add78199 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.227638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.228263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.228541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.228810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.257545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.258181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.258456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.258730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] PATH_INFO: `/v3/groups/fe425f6b2fc54d01ab025968497d6e94` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.259921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] RBAC: Authorizing `identity:get_group(group_id=fe425f6b2fc54d01ab025968497d6e94)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.261921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.263528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 230/450] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:22 2022] GET /identity/v3/groups/fe425f6b2fc54d01ab025968497d6e94 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:22.269508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:22.288524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:22.296737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.298238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.325969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:22.374067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd760b-ad0c-49a2-8068-2ef6bafffce9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.398267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 221/451] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 18:24:22.403935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:22.407426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.408045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.408322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.408591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.409374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] RBAC: Adding query filter params (group.id=fe425f6b2fc54d01ab025968497d6e94, role.id=15b0048e55a3471595e2de48b01ecb84, scope.project.id=1802d8d1d6e34024a1209fbec590f788) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:22.409683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.411156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.416822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 231/452] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:22 2022] GET /identity/v3/role_assignments?group.id=fe425f6b2fc54d01ab025968497d6e94&scope.project.id=1802d8d1d6e34024a1209fbec590f788&role.id=15b0048e55a3471595e2de48b01ecb84 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:22.508576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623489f-56fb-48a4-ada5-e987f8522d6d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.537166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:22.545336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.546001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.546282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.546556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] PATH_INFO: `/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.547781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ea2a81ace4d57afbbf4c3099ddcb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.549263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.551006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 222/453] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:24:22 2022] GET /identity/v3/projects/d68ea2a81ace4d57afbbf4c3099ddcb7 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:22.556548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:22.643049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:22.661521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb8cc-ce6d-4428-af70-2d7869922886 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.694896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69cac4-2a49-4272-921a-f55434ab87ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.695565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cac4-2a49-4272-921a-f55434ab87ba None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.695844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cac4-2a49-4272-921a-f55434ab87ba None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.696144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cac4-2a49-4272-921a-f55434ab87ba None admin] PATH_INFO: `/v3/groups/4b191454c3f24136b0c464b308eba70a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.697308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69cac4-2a49-4272-921a-f55434ab87ba None admin] RBAC: Authorizing `identity:get_group(group_id=4b191454c3f24136b0c464b308eba70a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.699426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69cac4-2a49-4272-921a-f55434ab87ba None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.701069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 232/454] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Jul 31 18:24:22 2022] GET /identity/v3/groups/4b191454c3f24136b0c464b308eba70a => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:22.707019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:22.810301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ff33-3afe-4021-8bd3-72a016e79155 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:22.843973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269d932-6756-447b-a184-b1786a0ee72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:22.844592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d932-6756-447b-a184-b1786a0ee72f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:22.844868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d932-6756-447b-a184-b1786a0ee72f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:22.845139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d932-6756-447b-a184-b1786a0ee72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:22.845910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d932-6756-447b-a184-b1786a0ee72f None admin] RBAC: Adding query filter params (group.id=4b191454c3f24136b0c464b308eba70a, role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=d68ea2a81ace4d57afbbf4c3099ddcb7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:22.846218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d932-6756-447b-a184-b1786a0ee72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:22.847684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d932-6756-447b-a184-b1786a0ee72f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:22.853413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 223/455] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Jul 31 18:24:22 2022] GET /identity/v3/role_assignments?group.id=4b191454c3f24136b0c464b308eba70a&scope.project.id=d68ea2a81ace4d57afbbf4c3099ddcb7&role.id=2f18a54954a047398aca6b1a7389586b => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:25.398280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac3ae-34f4-45e2-94f4-b0460880d286 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.399360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac3ae-34f4-45e2-94f4-b0460880d286 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.399865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac3ae-34f4-45e2-94f4-b0460880d286 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.402294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 233/456] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:25.407850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72395892-ad30-4c01-91c3-45f722a5d34a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.408665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72395892-ad30-4c01-91c3-45f722a5d34a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.409149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72395892-ad30-4c01-91c3-45f722a5d34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.451185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-72395892-ad30-4c01-91c3-45f722a5d34a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:25.452752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-72395892-ad30-4c01-91c3-45f722a5d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:25.529824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:25.541735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 224/457] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:25.580426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ac3ae-34f4-45e2-94f4-b0460880d286 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:25.679685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f68a3-9182-4ed7-a532-6ed167b48a08 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.679869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f68a3-9182-4ed7-a532-6ed167b48a08 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.680136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f68a3-9182-4ed7-a532-6ed167b48a08 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.681489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 225/458] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:25.686990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece00a2a-ba56-4d6a-b033-5dae3308ef5b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.687557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece00a2a-ba56-4d6a-b033-5dae3308ef5b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.688065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece00a2a-ba56-4d6a-b033-5dae3308ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.708448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ac3ae-34f4-45e2-94f4-b0460880d286 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:25.726020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ece00a2a-ba56-4d6a-b033-5dae3308ef5b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:25.727631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ece00a2a-ba56-4d6a-b033-5dae3308ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:25.745739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6b2fb-f20c-4b96-8347-e020c4be4076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:25.746716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6b2fb-f20c-4b96-8347-e020c4be4076 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.747397 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6b2fb-f20c-4b96-8347-e020c4be4076 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.748917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6b2fb-f20c-4b96-8347-e020c4be4076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.764304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6b2fb-f20c-4b96-8347-e020c4be4076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:25.766295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6b2fb-f20c-4b96-8347-e020c4be4076 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-bad6b2fb-f20c-4b96-8347-e020c4be4076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:25.786185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:25.787227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:25.788103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:25.788103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:25.788103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:25.788103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:25.791005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 234/459] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:25.793080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435691a-0894-4533-acbb-a5327929c75e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.793620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435691a-0894-4533-acbb-a5327929c75e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.794099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435691a-0894-4533-acbb-a5327929c75e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.795905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 235/460] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:25.796963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435691a-0894-4533-acbb-a5327929c75e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:25.800118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:25.814276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 226/461] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:25.815803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974033-2319-43fd-9f94-cc940388868f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.816092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974033-2319-43fd-9f94-cc940388868f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.816367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974033-2319-43fd-9f94-cc940388868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.849370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8b974033-2319-43fd-9f94-cc940388868f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:25.851788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b974033-2319-43fd-9f94-cc940388868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:25.936907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435691a-0894-4533-acbb-a5327929c75e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:25.945459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 227/462] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:25.947135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974033-2319-43fd-9f94-cc940388868f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:25.995794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:25.996742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:25.996742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:25.996928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:25.997632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:25.997936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:25.999607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.008616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:26.013386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 236/463] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:26.014602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.068457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974033-2319-43fd-9f94-cc940388868f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.080149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:26.106695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.107379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.107752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.108072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.120814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.122297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.123294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25db373-4506-4705-8769-53a4845176d8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:26.138003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:26.139336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:26.140427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:26.140427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:26.140427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:26.140427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:26.144237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 228/464] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:26.144983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.164010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a90b5-09e1-40d0-93f2-d82dd7d72025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.164919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a90b5-09e1-40d0-93f2-d82dd7d72025 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.165341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a90b5-09e1-40d0-93f2-d82dd7d72025 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.165793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a90b5-09e1-40d0-93f2-d82dd7d72025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.177262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a90b5-09e1-40d0-93f2-d82dd7d72025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.179085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a90b5-09e1-40d0-93f2-d82dd7d72025 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-db7a90b5-09e1-40d0-93f2-d82dd7d72025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:26.195367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:26.196411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:26.197481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:26.197481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:26.197481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:26.197481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:26.199765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 237/465] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:26.206321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a31ac-6139-4cf1-b997-e75c893b4849 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.206757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a31ac-6139-4cf1-b997-e75c893b4849 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.207260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a31ac-6139-4cf1-b997-e75c893b4849 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.208974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 238/466] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:26.209828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a31ac-6139-4cf1-b997-e75c893b4849 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.275946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37722-6f4a-4cc4-8e13-89c82c72d6e9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.277680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:26.334477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.335139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.335422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.335731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.336381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.338064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.342748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a31ac-6139-4cf1-b997-e75c893b4849 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.362042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:26.364121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 229/467] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:24:26 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:26.365205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.410485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730ada3-ce0f-45e4-a662-860679472950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.411220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ada3-ce0f-45e4-a662-860679472950 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.411425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ada3-ce0f-45e4-a662-860679472950 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.411745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ada3-ce0f-45e4-a662-860679472950 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.412461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ada3-ce0f-45e4-a662-860679472950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:26.412766 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ada3-ce0f-45e4-a662-860679472950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.414684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ada3-ce0f-45e4-a662-860679472950 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.430031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 239/468] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:26.431347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353652-27de-4080-9fe8-48a84b235e93 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.431691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353652-27de-4080-9fe8-48a84b235e93 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.431963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353652-27de-4080-9fe8-48a84b235e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.455161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-42353652-27de-4080-9fe8-48a84b235e93 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:26.456418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-42353652-27de-4080-9fe8-48a84b235e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:26.532021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0907e1f-6b9e-46fe-9c8a-dcf07f8dcc8a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.539660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 240/469] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:26.539995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353652-27de-4080-9fe8-48a84b235e93 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.580918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fdcd0-b6a1-4265-a698-bdd42fcdbab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.581938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fdcd0-b6a1-4265-a698-bdd42fcdbab1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.582402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fdcd0-b6a1-4265-a698-bdd42fcdbab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.582860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fdcd0-b6a1-4265-a698-bdd42fcdbab1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.584148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fdcd0-b6a1-4265-a698-bdd42fcdbab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:26.584676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fdcd0-b6a1-4265-a698-bdd42fcdbab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.587410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fdcd0-b6a1-4265-a698-bdd42fcdbab1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.603263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 230/470] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:26.605324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b402c-01eb-4d07-95dd-8e021870d8c9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.605613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b402c-01eb-4d07-95dd-8e021870d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.605888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b402c-01eb-4d07-95dd-8e021870d8c9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.608334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 231/471] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:26.609675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b402c-01eb-4d07-95dd-8e021870d8c9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.640475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:26.671675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353652-27de-4080-9fe8-48a84b235e93 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.674662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:26.714156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.714807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.715136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.715410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.716100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.717557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.740657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 241/472] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:24:26 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:26.741262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.744027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b402c-01eb-4d07-95dd-8e021870d8c9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.795022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25f98-8cd6-4b97-b529-e5b4513d1cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.795817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25f98-8cd6-4b97-b529-e5b4513d1cfb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.796102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25f98-8cd6-4b97-b529-e5b4513d1cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.796373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25f98-8cd6-4b97-b529-e5b4513d1cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.811141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25f98-8cd6-4b97-b529-e5b4513d1cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.813773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25f98-8cd6-4b97-b529-e5b4513d1cfb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-dff25f98-8cd6-4b97-b529-e5b4513d1cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:26.831303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:26.833250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:26.834462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:26.834462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:26.834462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:26.834462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:26.835165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 232/473] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:26.836693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980333aa-252d-4d02-a1b9-aa0bcb77eeb9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.837090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980333aa-252d-4d02-a1b9-aa0bcb77eeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.837460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980333aa-252d-4d02-a1b9-aa0bcb77eeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.859527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-980333aa-252d-4d02-a1b9-aa0bcb77eeb9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:26.860599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-980333aa-252d-4d02-a1b9-aa0bcb77eeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:26.908618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43257d-d201-4ece-8024-7b159c2b8d04 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:26.935074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:26.941676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 233/474] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:26.943047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980333aa-252d-4d02-a1b9-aa0bcb77eeb9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:26.980037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:26.980959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:26.981392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:26.981829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:26.982695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:26.984404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:27.008377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 242/475] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:24:26 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:27.009499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:27.039908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:27.110960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980333aa-252d-4d02-a1b9-aa0bcb77eeb9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:27.174013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a04525-5809-405a-b439-fb25389a8475 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:27.189771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:27.190435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:27.190698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:27.190987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:27.191690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:27.191994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:27.193392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:27.217383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 234/476] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:27.218914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:27.235199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:27.235765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:27.236044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:27.236605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:27.237040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:27.238434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:27.249364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.sql.core [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 18:24:27.249364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 18:24:27.249364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [parameters: {'id': '977a324af7c24c09ba3d6ac9a36c2149', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 18:24:27.249364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80136) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application conn.query(q) Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result.read() Jul 31 18:24:27.268094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return ref.to_dict() Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 18:24:27.269250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application next(self.gen) Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application yield resource Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application next(self.gen) Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise self.value Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application session.commit() Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 18:24:27.270537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.session.flush() Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application compat.raise_( Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 18:24:27.272414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 18:24:27.273782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application conn.query(q) Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result.read() Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 18:24:27.274905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [parameters: {'id': '977a324af7c24c09ba3d6ac9a36c2149', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:27.275995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 18:24:27.279033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:27.281030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 243/477] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Jul 31 18:24:27 2022] POST /identity/v3/roles => generated 144 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:27.281030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:27.303634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:27.344809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b5046-56d2-4d71-b66a-6eb2820204b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:27.375921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:27.382590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:27.383553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:27.384060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:27.384550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:27.386073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:27.387974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:27.398765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7005-0f6b-499c-aebb-92176e77c572 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:27.414624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 235/478] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:24:27 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:27.447596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aa359-dc82-4ee6-b1f9-a60f3971cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:27.449435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aa359-dc82-4ee6-b1f9-a60f3971cc3b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:27.449721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aa359-dc82-4ee6-b1f9-a60f3971cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:27.449997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aa359-dc82-4ee6-b1f9-a60f3971cc3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:27.463084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aa359-dc82-4ee6-b1f9-a60f3971cc3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6f9aa359-dc82-4ee6-b1f9-a60f3971cc3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:27.468252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:27.469279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:27.470142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 244/479] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:24:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:27.475698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:27.603864 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26de877-5632-4aa6-a43c-f4d1ff79a516 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:27.622305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:27.642063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a506a-f0a8-46dd-930a-f1abdd26189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:27.642693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a506a-f0a8-46dd-930a-f1abdd26189d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:27.642992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a506a-f0a8-46dd-930a-f1abdd26189d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:27.643268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a506a-f0a8-46dd-930a-f1abdd26189d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:27.643987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a506a-f0a8-46dd-930a-f1abdd26189d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:27.644289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a506a-f0a8-46dd-930a-f1abdd26189d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:27.645726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a506a-f0a8-46dd-930a-f1abdd26189d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:27.656248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 236/480] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:28.749553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b3e3-827e-4e32-bbe2-9794cd4959e3 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:28.750038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b3e3-827e-4e32-bbe2-9794cd4959e3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:28.750038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b3e3-827e-4e32-bbe2-9794cd4959e3 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:28.751662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 245/481] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:28.767833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497d87-8553-48b7-b0ac-2a80123e047a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:28.768330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497d87-8553-48b7-b0ac-2a80123e047a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:28.768408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497d87-8553-48b7-b0ac-2a80123e047a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:28.793277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a0497d87-8553-48b7-b0ac-2a80123e047a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:28.794478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a0497d87-8553-48b7-b0ac-2a80123e047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:28.884428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 237/482] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:28.927601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53b3e3-827e-4e32-bbe2-9794cd4959e3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:29.052615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53b3e3-827e-4e32-bbe2-9794cd4959e3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:29.098799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:29.099477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.103246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.103246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.113227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:29.123340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:29.128391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:29.129338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:29.131159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 246/483] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:29.136033 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0497d87-8553-48b7-b0ac-2a80123e047a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:29.286295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0497d87-8553-48b7-b0ac-2a80123e047a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:29.300946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:29.335242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b694a4d-921e-49b9-9c88-2d9d9f1809b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:29.335788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b694a4d-921e-49b9-9c88-2d9d9f1809b5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.336068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b694a4d-921e-49b9-9c88-2d9d9f1809b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.336337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b694a4d-921e-49b9-9c88-2d9d9f1809b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.337050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b694a4d-921e-49b9-9c88-2d9d9f1809b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:29.337352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b694a4d-921e-49b9-9c88-2d9d9f1809b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:29.338824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b694a4d-921e-49b9-9c88-2d9d9f1809b5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:29.350740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 238/484] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:29.356279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:29.500797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57175257-a1c0-40f8-b068-2aaa1960075c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:29.531950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7568-f3d6-42c4-a239-a0d974b83c31 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.532308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7568-f3d6-42c4-a239-a0d974b83c31 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.532507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7568-f3d6-42c4-a239-a0d974b83c31 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.533979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 239/485] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:29.539985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc063a-9bd8-49cd-bf9b-fe0bb087cf0c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.542252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc063a-9bd8-49cd-bf9b-fe0bb087cf0c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.542828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc063a-9bd8-49cd-bf9b-fe0bb087cf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.566086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105a738-53f9-4477-9883-22c7c62ad41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:29.567109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105a738-53f9-4477-9883-22c7c62ad41e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.567614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105a738-53f9-4477-9883-22c7c62ad41e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.568115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105a738-53f9-4477-9883-22c7c62ad41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.574523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7cbc063a-9bd8-49cd-bf9b-fe0bb087cf0c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:29.576675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7cbc063a-9bd8-49cd-bf9b-fe0bb087cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:29.588228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105a738-53f9-4477-9883-22c7c62ad41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:29.589727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105a738-53f9-4477-9883-22c7c62ad41e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c105a738-53f9-4477-9883-22c7c62ad41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:29.605305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:29.606178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:29.607075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:29.607075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:29.607075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:29.607075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:29.609175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 247/486] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:29.610540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4e4c-6094-433e-916f-e6896c5ce92d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.611038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4e4c-6094-433e-916f-e6896c5ce92d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.611521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4e4c-6094-433e-916f-e6896c5ce92d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.613161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 248/487] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:29.614204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4e4c-6094-433e-916f-e6896c5ce92d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:29.669799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 240/488] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:29.669799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7951b4-a194-40da-a1e8-b11d2158b4c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.669799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7951b4-a194-40da-a1e8-b11d2158b4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.669799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7951b4-a194-40da-a1e8-b11d2158b4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.686037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bb7951b4-a194-40da-a1e8-b11d2158b4c3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:29.690974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:29.691100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bb7951b4-a194-40da-a1e8-b11d2158b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:29.748078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4e4c-6094-433e-916f-e6896c5ce92d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:29.766022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 241/489] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:29.772045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7951b4-a194-40da-a1e8-b11d2158b4c3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:29.802869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:29.803553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.803838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.804117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.804821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:29.805129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:29.805236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:29.806533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:29.820319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 249/490] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:29.821172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:29.887677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7951b4-a194-40da-a1e8-b11d2158b4c3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:29.929683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:29.930591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.930870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.931166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:29.946703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:29.948496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67b418-223f-4089-a4ae-3212019186cf None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:29.953159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:29.954040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 242/491] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:29.956452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:29.964617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:29.992465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:29.993279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:29.993657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:29.994030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.005246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:30.010380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:30.012753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 250/492] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:30.015085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.075135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.086555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23d6d4-cde2-40a4-9667-045e2ea127a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.124177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.125066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.125505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.125794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.133301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.134761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.139211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3498-9a51-4d8d-a89d-0137b2088f15 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:30.149376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:30.150522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 18:24:30.152282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:30.155195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 243/493] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:30.156044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.183788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.184780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.185504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.186062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.187042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:30.187659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.189756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.200311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 251/494] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:30.201881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.238622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.267603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe26b1-99d0-46b1-8ec5-6475f88273a2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.303605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b43fc-aa55-4107-8632-eda0060308fc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.304559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.305458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.306633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.306950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.307849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:30.308162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.309561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.326399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 244/495] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:30.327403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.341012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1f52f-5abc-45a8-837a-9779007cfff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.341643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f52f-5abc-45a8-837a-9779007cfff7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.341984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f52f-5abc-45a8-837a-9779007cfff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.342262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f52f-5abc-45a8-837a-9779007cfff7 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.343115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f52f-5abc-45a8-837a-9779007cfff7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:30.343422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f52f-5abc-45a8-837a-9779007cfff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.344221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.344863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f52f-5abc-45a8-837a-9779007cfff7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.381927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 252/496] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:30.383194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19af9-96e9-4ec8-af00-8052e2858af3 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.383482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19af9-96e9-4ec8-af00-8052e2858af3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.383758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19af9-96e9-4ec8-af00-8052e2858af3 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.384973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 253/497] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:30.385729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19af9-96e9-4ec8-af00-8052e2858af3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.435276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d89170-0139-4485-98fb-e0fd1699005e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.469907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d41d9-f1f4-4aa5-9eaa-7bdda543d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.470547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d41d9-f1f4-4aa5-9eaa-7bdda543d78e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.470823 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d41d9-f1f4-4aa5-9eaa-7bdda543d78e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.471124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d41d9-f1f4-4aa5-9eaa-7bdda543d78e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.478339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.481998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d41d9-f1f4-4aa5-9eaa-7bdda543d78e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.483506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d41d9-f1f4-4aa5-9eaa-7bdda543d78e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.489613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19af9-96e9-4ec8-af00-8052e2858af3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-168d41d9-f1f4-4aa5-9eaa-7bdda543d78e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:30.497529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:30.498418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:30.499299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:30.499299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:30.499299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:30.499299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:30.499299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 245/498] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:30.499898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c88c-f2f7-4571-ac8a-3645725d868e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.500129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c88c-f2f7-4571-ac8a-3645725d868e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.500390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c88c-f2f7-4571-ac8a-3645725d868e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.501633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 246/499] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:30.502318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79c88c-f2f7-4571-ac8a-3645725d868e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.527348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2d906-b6a3-482b-8eab-fa3a5f8052d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.527989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2d906-b6a3-482b-8eab-fa3a5f8052d0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.528267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2d906-b6a3-482b-8eab-fa3a5f8052d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.528539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2d906-b6a3-482b-8eab-fa3a5f8052d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.538294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2d906-b6a3-482b-8eab-fa3a5f8052d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.539774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2d906-b6a3-482b-8eab-fa3a5f8052d0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c9c2d906-b6a3-482b-8eab-fa3a5f8052d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:30.554436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:30.555430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:30.556293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:30.556293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:30.556293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:30.556293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:30.556293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 254/500] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:30.557030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c0322-98fd-44c3-8e1e-56f1bd208976 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.557169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c0322-98fd-44c3-8e1e-56f1bd208976 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.557502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c0322-98fd-44c3-8e1e-56f1bd208976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.566730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.576327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-924c0322-98fd-44c3-8e1e-56f1bd208976 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:30.577519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-924c0322-98fd-44c3-8e1e-56f1bd208976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:30.606353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79c88c-f2f7-4571-ac8a-3645725d868e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.640245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.640858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.641133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.641396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.647433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 255/501] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:30.648249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c0322-98fd-44c3-8e1e-56f1bd208976 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.709219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.710606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.720447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.745922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c0322-98fd-44c3-8e1e-56f1bd208976 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.769284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.780372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5edc16-326b-44e5-a7e3-63d1e22188b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.780989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5edc16-326b-44e5-a7e3-63d1e22188b0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.781267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5edc16-326b-44e5-a7e3-63d1e22188b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.781538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5edc16-326b-44e5-a7e3-63d1e22188b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.782222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5edc16-326b-44e5-a7e3-63d1e22188b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:30.782526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5edc16-326b-44e5-a7e3-63d1e22188b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.783956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5edc16-326b-44e5-a7e3-63d1e22188b0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.796145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 256/502] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:30.797343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0502-9b62-4a18-8dc7-b8013ea7f9a9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.797623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0502-9b62-4a18-8dc7-b8013ea7f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.800217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0502-9b62-4a18-8dc7-b8013ea7f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.808681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 247/503] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:30.809510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.823591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e7bf0502-9b62-4a18-8dc7-b8013ea7f9a9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:30.824804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e7bf0502-9b62-4a18-8dc7-b8013ea7f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:30.891551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 257/504] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:30.892201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0502-9b62-4a18-8dc7-b8013ea7f9a9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.905579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e2197-23c0-45ea-a94f-c6412f1b0bc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:30.939327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:30.939949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:30.940228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:30.940497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:30.941185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:30.941480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:30.942846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:30.954402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 248/505] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:30.955385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:30.971839 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:30.981977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.008870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0502-9b62-4a18-8dc7-b8013ea7f9a9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.043539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.044182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.044459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.044729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.054803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:31.055719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc08bb-e432-4249-a374-2c0db2ebaba9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:31.059823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:31.060862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:31.061955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 258/506] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:31.066418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.089618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.090252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.090530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.090801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.098337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.099847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:31.111622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:31.112703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 249/507] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:24:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:31.113892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.171554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c571c0-e4a7-4174-8af8-abbbc893f8d4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.194184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.194442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.206627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.207301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.207590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.207860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.210866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8df80-d5af-4a67-8f0b-25b6bfe74b79 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.218734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.220242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:31.235564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:31.236545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:31.237402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:31.237402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:31.237402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:31.237402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:31.237402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 259/508] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:31.237402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.249463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.250103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.250377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.250646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.260926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.262367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:31.276463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:31.277530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:31.283461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:31.283461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:31.283461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:31.283461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:31.283461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 250/509] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:31.283461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.337764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c88e-7e64-418f-9dfe-c99a44b47698 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.370713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.371378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.371653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.371920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.378482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81474e98-aead-44f9-9512-dd606eef527b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.379159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.380653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:31.393227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:31.394278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 260/510] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:31.395231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.417708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.418339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.418622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.418898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.419679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:31.419982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.421386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.423554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.430115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 251/511] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:31.430759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.435357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.502792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fe19-5fbe-4027-90b4-96915e353efa None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.532205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a768-d27a-4916-8849-4b391ce0f7a4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.535495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.536116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.536392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.536662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.537448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:31.537751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.539260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.555792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 261/512] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:31.556580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.565043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.565664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.565948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.566223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.566925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:31.567257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.568650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.580955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 252/513] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:31.581737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.639109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.653274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.660384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8eddec-678d-4840-8362-93430ede54c4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.679748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461283-df4a-4f63-a29b-00596954eee5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.694147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.694759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.695070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.695337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.696014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:31.696313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.698441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.709555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 262/514] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:31.710321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.715620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.716258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.716541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.716817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.717643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:31.717954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.719420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.756467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 253/515] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:31.757214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.814205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ca963-6ee9-429e-be94-a5e591d3c96a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.846675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.847345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.847598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.847865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.858234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2f02-b77f-42db-a868-6041e7d89183 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:31.858834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.860380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.874749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:31.874888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:31.875824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:31.877319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:31.877319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:31.877319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:31.877319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:31.877319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 263/516] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:31.877319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:31.886723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:31.898297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:31.898920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:31.899233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:31.899509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:31.965408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:31.966893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:31.976668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bb7e5-94ab-43e0-bd35-c224ead89771 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.009260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.009816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.010624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.011453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.018156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.019699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:32.031483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:32.032529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 264/517] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:32.033423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.068212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 254/518] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:32.069044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.085596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.105136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.140052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436cc9c-25aa-4be4-883a-8cb411c98aa0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.167843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e3f56-2694-4ebd-99ec-83601d33552f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.172679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.173322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.173602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.173876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.174554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.176030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.197512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 265/519] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:24:32 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:32.198627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.215674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab344784-8223-4880-8155-631c02b244af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.216419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab344784-8223-4880-8155-631c02b244af None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.216703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab344784-8223-4880-8155-631c02b244af None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.216975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab344784-8223-4880-8155-631c02b244af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.295750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab344784-8223-4880-8155-631c02b244af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.297154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab344784-8223-4880-8155-631c02b244af None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.315820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443eb46-b35e-497d-930d-6e2589ad5494 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.322470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.342513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.358664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.359356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.360448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.360448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.360610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:32.360849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.362406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.374691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 266/520] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:32.375452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.423263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 255/521] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:32.423263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab344784-8223-4880-8155-631c02b244af None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.487349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c764d-8b77-47a6-8f43-38b9e3aed5c9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.525333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.526167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.526549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.526957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.527816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:32.528229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.529760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.533829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab344784-8223-4880-8155-631c02b244af None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.548901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 267/522] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:32.551647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.554444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.573211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.574310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.574764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.575169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.586647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.588577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.597179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:32.606833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:32.607896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:32.608952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:32.608952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:32.608952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:32.608952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:32.614287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 256/523] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:32.614287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.660119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701a33-ba63-4f94-b890-36c031f4985f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.696628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.697368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.698422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.698916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.707680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.709139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.719127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e074-f69d-4c98-b0d7-be42d3eb6197 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:32.720807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:32.721896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 18:24:32.723316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:32.726580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 268/524] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:32.727446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.759119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.759907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.760851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.761351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.773814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.775547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:32.790894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:32.792725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:32.793744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:32.793744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:32.793744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:32.793744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:32.793744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 257/525] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:32.794244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.817113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.834003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d129e30-8a1f-4d8a-bdc6-ad69a485b974 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.835649 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:32.870005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.870672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.871679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.871679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.872029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=2f49e424f08d40c5880a8ce3ca1cac59) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:32.872335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.873766 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.886961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 269/526] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/role_assignments?user.id=2f49e424f08d40c5880a8ce3ca1cac59&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:32.886961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:32.914657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cceb62-0661-4514-a909-682aa2609ffe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:32.961466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:32.962203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:32.962554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:32.964030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:32.964923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:32.965471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:32.967216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:32.987106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 258/527] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:32.988216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.025265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06547-9dff-47fd-9a1b-0074ef473caf None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.066264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.067316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.067814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.068288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.069509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:33.069917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.071481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.092557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:33.096402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 270/528] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:33.098611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.118726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839ab87-8c33-42e6-a1dd-d04c396d915b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.126383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:33.172536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.173683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.174137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.174561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.175677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:33.177080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.178676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.195136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 259/529] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:33.196224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.214692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac5fa-9144-4599-a62b-02a6800e83e5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.253767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.254509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.254860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.255229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.262331 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.266000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:33.292483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:33.293396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 271/530] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:33.294256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.357214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede37bae-0343-4f8a-aa5c-a6ce58670407 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.403793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.404458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.404742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.405521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.410779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:33.420345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:33.445247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b565a-865b-4d58-bda0-7027023515de None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.496329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.497148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.497495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.497838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.503763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.505240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.512918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.514920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:33.531749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:33.532641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:33.533506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:33.535634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 272/531] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:33.536535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.635861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 260/532] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:33.636868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.671028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c400d-a048-400f-8adb-a48c6edb206a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.680352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:33.721910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.723413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.724349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.724966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.726047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:33.726810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.728964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.742514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac82ea1-6fb6-4843-bb14-987231eb82f6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.747420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 273/533] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:33.748539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.752836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:33.781695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.782321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.782601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.782903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.783673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:33.783983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.785564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.809867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 261/534] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:33.810866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.873504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147df521-e73a-4e3d-9514-779a517bb5b2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.909785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.910386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.910727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.911038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:33.922986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:33.924466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:33.938426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:33.942019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acca5e-6c01-49c4-b1b9-423df762d600 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:33.942703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:33.950439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:33.951336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:33.951336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:33.951336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:33.951336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:33.951336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 274/535] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:33.951336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:33.996242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:33.997534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:33.998015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:33.998731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.000284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:34.001068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:34.003247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:34.011975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:34.013437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 262/536] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/role_assignments?user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:34.014673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:34.075402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f0c7d-581d-4a9d-9aac-c8ff93519fd3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:34.154681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:34.155427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.155704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.155974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.156782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=b9970bd7f09446339fb291e591cdfbfb) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:34.157086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:34.158553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:34.182761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 275/537] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:33 2022] GET /identity/v3/role_assignments?user.id=b9970bd7f09446339fb291e591cdfbfb&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:34.201256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111968a-ce93-4ade-80f5-22d506b888df None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:34.248838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53daa-bf59-47c9-8606-d6fb1598a152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:34.249487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53daa-bf59-47c9-8606-d6fb1598a152 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.249770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53daa-bf59-47c9-8606-d6fb1598a152 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.250045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53daa-bf59-47c9-8606-d6fb1598a152 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.250748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53daa-bf59-47c9-8606-d6fb1598a152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:34.251078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53daa-bf59-47c9-8606-d6fb1598a152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:34.252472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53daa-bf59-47c9-8606-d6fb1598a152 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:34.269780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 263/538] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:34.275078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:34.315847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8f9b-51c0-42b3-99cc-0cbfed395166 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.316167 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8f9b-51c0-42b3-99cc-0cbfed395166 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.316399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8f9b-51c0-42b3-99cc-0cbfed395166 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.317760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 264/539] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:34.336003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128267a-5d25-4ba3-89a6-46bfbea641c1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.336318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128267a-5d25-4ba3-89a6-46bfbea641c1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.336556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128267a-5d25-4ba3-89a6-46bfbea641c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.363895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0128267a-5d25-4ba3-89a6-46bfbea641c1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:34.365158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0128267a-5d25-4ba3-89a6-46bfbea641c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:34.406866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:34.465609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86a138-d4ed-4625-ae32-b388edd6e804 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:34.484058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 265/540] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:34.501224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:34.520428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:34.521083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.521422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.521696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.535755 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:34.537238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:34.544842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128267a-5d25-4ba3-89a6-46bfbea641c1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:34.550132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:34.551029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:34.551895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 276/541] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:34.557268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:34.665964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c37cb-4ce9-4854-99f2-7702d5ee36e7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:34.711559 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:34.712186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.712461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.712733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.714128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:34.714438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:34.715982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:34.720456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128267a-5d25-4ba3-89a6-46bfbea641c1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:34.748234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 277/542] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:34.754201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:34.789510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:34.790162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.790439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.790709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.813686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:34.816491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:34.821530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:34.824259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:34.826250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:34.832532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 266/543] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:34.838755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:34.867221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:34.887761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b9a9-e2ce-42ee-a216-a76f08e47868 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:34.953659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:34.954281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:34.954554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:34.954820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:34.955640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=235416b3ebfc42f48be079760f271fae) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:34.955940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:34.957373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:34.968059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 278/544] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:34 2022] GET /identity/v3/role_assignments?user.id=235416b3ebfc42f48be079760f271fae&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:35.030761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6e3a8-5804-4721-88fe-b4e4675a344e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:35.090453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a923dc-9471-460c-a066-5fb7ddb41d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:35.091120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a923dc-9471-460c-a066-5fb7ddb41d99 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:35.091399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a923dc-9471-460c-a066-5fb7ddb41d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:35.091665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a923dc-9471-460c-a066-5fb7ddb41d99 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:35.092396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a923dc-9471-460c-a066-5fb7ddb41d99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:35.092696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a923dc-9471-460c-a066-5fb7ddb41d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:35.094106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a923dc-9471-460c-a066-5fb7ddb41d99 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:35.109010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 267/545] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:35.114417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:35.220223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e5c9d-00c4-403b-b8f2-0efe1476d374 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:35.223271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:35.230131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022871d7-a7e5-42cb-9335-263a5e5b2957 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:35.230412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022871d7-a7e5-42cb-9335-263a5e5b2957 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:35.230687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022871d7-a7e5-42cb-9335-263a5e5b2957 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:35.232452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 268/546] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:35.237468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378849c-7d85-4a7a-87d7-d19cc3cb497e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:35.237751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378849c-7d85-4a7a-87d7-d19cc3cb497e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:35.238449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378849c-7d85-4a7a-87d7-d19cc3cb497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:35.259378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c378849c-7d85-4a7a-87d7-d19cc3cb497e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:35.261092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c378849c-7d85-4a7a-87d7-d19cc3cb497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:35.283846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:35.284495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:35.284769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:35.285038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:35.304135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:35.305595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:35.339869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:35.340779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:35.341640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:35.341640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:35.341640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:35.341640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:35.344605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 279/547] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:35.348988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:35.385253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 269/548] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:35.460691 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378849c-7d85-4a7a-87d7-d19cc3cb497e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:35.469432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:35.535284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a503-ce5c-4ce6-a248-5566075ad802 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:35.579654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:35.581304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:35.581591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:35.581866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:35.582572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:35.582875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:35.585360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:35.602124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 280/549] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:35.612227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:35.655313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:35.807036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80847ca8-70df-46cc-b8af-bae151077a1e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:35.812984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378849c-7d85-4a7a-87d7-d19cc3cb497e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:35.891244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:35.891938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:35.892166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:35.892434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:35.900277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:35.902594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:35.925137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:35.926592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:35.927741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:35.931862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 281/550] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:35.933263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:35.951673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:35.952346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:35.952690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:35.952972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:35.996377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:36.001340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:36.003479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:36.005479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:36.011405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 270/551] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 544 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:36.015923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:36.144044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:36.168224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc5454-da1a-4df0-a868-d4b63f533cd5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.197740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:36.206633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:36.207579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.208058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.208601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.209728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:36.210245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:36.211906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:36.231048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 282/552] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Jul 31 18:24:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:36.236060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:36.301114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a8c49-7fba-4141-a941-287c5d36d5ab None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.339806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c6bcc-90a8-4295-9b29-d0c4940a165f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.376849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e5308-c44b-403f-bd45-fb0e19dda0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:36.378427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e5308-c44b-403f-bd45-fb0e19dda0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.379174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e5308-c44b-403f-bd45-fb0e19dda0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.379651 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e5308-c44b-403f-bd45-fb0e19dda0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.383595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:36.399809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34b39e-0d09-4898-9746-b3549a4e8f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:36.400303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b39e-0d09-4898-9746-b3549a4e8f63 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.400656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b39e-0d09-4898-9746-b3549a4e8f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.401137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b39e-0d09-4898-9746-b3549a4e8f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.401679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34b39e-0d09-4898-9746-b3549a4e8f63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:36.401985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34b39e-0d09-4898-9746-b3549a4e8f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:36.403926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34b39e-0d09-4898-9746-b3549a4e8f63 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:36.412292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 271/553] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:36.413277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152bc99-4ffa-4bc2-b9bd-def6bed84c99 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.413599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152bc99-4ffa-4bc2-b9bd-def6bed84c99 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.413838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152bc99-4ffa-4bc2-b9bd-def6bed84c99 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.415340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 272/554] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:36.418523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152bc99-4ffa-4bc2-b9bd-def6bed84c99 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:36.457575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e5308-c44b-403f-bd45-fb0e19dda0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:36.459883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e5308-c44b-403f-bd45-fb0e19dda0d3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:36.544945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152bc99-4ffa-4bc2-b9bd-def6bed84c99 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.580335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:36.588743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 283/555] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:36.590195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce46b1-5ca8-40ee-b323-c73478da6a7a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.590579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce46b1-5ca8-40ee-b323-c73478da6a7a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.590964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce46b1-5ca8-40ee-b323-c73478da6a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.592025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:36.592836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.593556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.593979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.607497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:36.609198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:36.610451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-59ce46b1-5ca8-40ee-b323-c73478da6a7a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:36.611936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-59ce46b1-5ca8-40ee-b323-c73478da6a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:36.629100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:36.630217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:36.631225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:36.631225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:36.631225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:36.631225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:36.633622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 273/556] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:36.634706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:36.647619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:36.690256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 284/557] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:36.696363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce46b1-5ca8-40ee-b323-c73478da6a7a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:36.749722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbb468-4420-46b7-90c2-03a41aa6cc5a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.784449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323caed-1ff6-497c-b544-6c8b8aa81172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:36.785087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323caed-1ff6-497c-b544-6c8b8aa81172 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.785378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323caed-1ff6-497c-b544-6c8b8aa81172 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.785642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323caed-1ff6-497c-b544-6c8b8aa81172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.796954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323caed-1ff6-497c-b544-6c8b8aa81172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:36.798609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323caed-1ff6-497c-b544-6c8b8aa81172 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:36.808211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce46b1-5ca8-40ee-b323-c73478da6a7a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a323caed-1ff6-497c-b544-6c8b8aa81172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:36.814701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:36.816245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:36.817355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:36.817355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:36.817355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:36.817355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:36.818847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 274/558] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:36.820205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a209e-fdaa-47e1-b0a7-461a7f8306db None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.820493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a209e-fdaa-47e1-b0a7-461a7f8306db None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.820768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a209e-fdaa-47e1-b0a7-461a7f8306db None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.822187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 275/559] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:36.823867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a209e-fdaa-47e1-b0a7-461a7f8306db None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:36.850412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:36.851078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.851357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.851623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.852425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:36.852842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:36.855273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:36.859595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:36.873043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 285/560] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:36.873043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:36.899107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:36.937721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a209e-fdaa-47e1-b0a7-461a7f8306db None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.971234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57715cd8-43b7-4bb0-ac41-cbfca9bdc033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:36.971798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715cd8-43b7-4bb0-ac41-cbfca9bdc033 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.972073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715cd8-43b7-4bb0-ac41-cbfca9bdc033 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.972334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715cd8-43b7-4bb0-ac41-cbfca9bdc033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:36.980958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a98a6-6a72-4cc5-a72a-11f644a248d2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:36.985255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57715cd8-43b7-4bb0-ac41-cbfca9bdc033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-57715cd8-43b7-4bb0-ac41-cbfca9bdc033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:36.990605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:36.991850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:36.992715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 276/561] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:36.993419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f743-917d-4ec5-b55c-0d7cd9ad5c4c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:36.994950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f743-917d-4ec5-b55c-0d7cd9ad5c4c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:36.994950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f743-917d-4ec5-b55c-0d7cd9ad5c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.013683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0752f743-917d-4ec5-b55c-0d7cd9ad5c4c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:37.015176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0752f743-917d-4ec5-b55c-0d7cd9ad5c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:37.025377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.026612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.026949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.027225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.027905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:37.028209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.029578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.046808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 286/562] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:37.046808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.095169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 277/563] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:37.095169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f743-917d-4ec5-b55c-0d7cd9ad5c4c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.124606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.141765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.160988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a48de4-9550-437a-b86f-4855131225f5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.195260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.195899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.196172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.196442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.203499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f743-917d-4ec5-b55c-0d7cd9ad5c4c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.203993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.205420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:37.217163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:37.218183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 287/564] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:37.219184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.243735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.244406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.244738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.245107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.245829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:37.246137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.247563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.260709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 278/565] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:37.260709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.330707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d9d96-00a4-4d1f-ba56-bb7010baa120 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.350386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.365354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.366082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.366430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.366761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.370817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f333-cc03-4007-b6f6-3ffe70f4b6a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.374193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.375742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:37.387205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:37.388299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:37.389603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 288/566] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:37.390480 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.394909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.415594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.417332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.417620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.417892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.428342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:37.434672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:37.435815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:37.436761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 279/567] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:37.437470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.497411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a11101-152d-4a99-8ae1-9a7c294af920 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.532562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.533259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.533448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.533721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.534504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:37.534808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.536270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.536783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c6332-8dc0-409b-8250-b1aff68972f1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.553362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 289/568] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:37.554152 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.570565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf97db-4175-4377-8ae4-fce50d6cdcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.571244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf97db-4175-4377-8ae4-fce50d6cdcda None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.571520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf97db-4175-4377-8ae4-fce50d6cdcda None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.571790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf97db-4175-4377-8ae4-fce50d6cdcda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.582716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf97db-4175-4377-8ae4-fce50d6cdcda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.584348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf97db-4175-4377-8ae4-fce50d6cdcda None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.586961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9ccf97db-4175-4377-8ae4-fce50d6cdcda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:37.599947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:37.601037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:37.602269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:37.602269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:37.602269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:37.602269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:37.602269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 280/569] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:37.602623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a882-f234-40e3-b6fa-f10a2802c985 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.602806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a882-f234-40e3-b6fa-f10a2802c985 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.603111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a882-f234-40e3-b6fa-f10a2802c985 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.604430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 281/570] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:37.605116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64a882-f234-40e3-b6fa-f10a2802c985 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.620851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.659420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065c43-5341-4d0a-99e1-e0724e890652 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.692690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.693304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.693580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.693848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.694587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:37.694891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.696350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.708345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 290/571] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:37.708953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.715782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64a882-f234-40e3-b6fa-f10a2802c985 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.749599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.750159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.750438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.750713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.751460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:37.751767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.753142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.760860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 282/572] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:37.761638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.807917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1038e-0a4b-4ad4-805f-34a576d379de None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.819255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.829510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:37.840676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad139d8-5d67-4c83-a432-fdcf3c36aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.841309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad139d8-5d67-4c83-a432-fdcf3c36aac2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.841582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad139d8-5d67-4c83-a432-fdcf3c36aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.841850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad139d8-5d67-4c83-a432-fdcf3c36aac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.852053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad139d8-5d67-4c83-a432-fdcf3c36aac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.853485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad139d8-5d67-4c83-a432-fdcf3c36aac2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.860951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036725e-2e44-4ed1-a1f9-aa3726760a8f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0ad139d8-5d67-4c83-a432-fdcf3c36aac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:37.868018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:37.869071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:37.870598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:37.870598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:37.870598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:37.870598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:37.870598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 291/573] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:37.871444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919346-07ba-4767-baff-c8ef3b7204b9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.871444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919346-07ba-4767-baff-c8ef3b7204b9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.871713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919346-07ba-4767-baff-c8ef3b7204b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.889838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1d919346-07ba-4767-baff-c8ef3b7204b9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:37.891035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d919346-07ba-4767-baff-c8ef3b7204b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:37.896839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:37.897459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:37.897743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:37.898015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:37.898691 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:37.899021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:37.900404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:37.912362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 283/574] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:37.912362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:37.962458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 292/575] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:37.963959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d919346-07ba-4767-baff-c8ef3b7204b9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.015565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317076-e1d7-42ef-a0b9-e2cac7f16240 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.032550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.049685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.050308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.050585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.050858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.051663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=25905fe87291438aa787ecada5cb6865) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:38.051972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.053429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.059649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 284/576] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/role_assignments?user.id=25905fe87291438aa787ecada5cb6865&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:38.060416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.064813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d919346-07ba-4767-baff-c8ef3b7204b9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.067350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.108873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.109687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.110036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.110385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.123104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.124728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:38.142167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:38.143394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:38.144294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:38.144294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:38.144294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:38.144294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:38.144294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 293/577] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:38.144294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.199427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70fae3-a8aa-4413-a140-17101dee0dba None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.244636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.245648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.245938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.246215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.246908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:38.247248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.249088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.261144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 285/578] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:38.261779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.263694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63d0e0-b558-4f5c-ab07-956c0627a5e0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.304136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.304719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.304998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.305272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.309046 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.314860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.316340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:38.328564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:38.329735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 294/579] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:38.330752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.350862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.376984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243ec45-2b0d-4dd7-99e9-0dbe620b7b8a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.413596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.414394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.414776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.415195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.427155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:38.432581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:38.433695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:38.434751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:38.439449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 286/580] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:38.439449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.439662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037af117-00c2-4374-bbbc-745b38082b6e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.476102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.476981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.477456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.477793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.479084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:38.479512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.481137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.494988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 295/581] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:38.499561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.555280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caee28-816c-4757-8c0f-350b475c91d2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.557475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.576935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.594011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.594656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.594960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.595241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.602011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.603247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3941-c760-43bb-b474-46bfb011d6f8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.603546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:38.617893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:38.619054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 287/582] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:38.620578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.646131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.646879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.647278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.647644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.648520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:38.648921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.650484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.672805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 296/583] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:38.672805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.738871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6015bf-d7c3-450b-abb0-8c950c3887e9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.769713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d79b4-cbd5-4a38-bcb3-440ede2baa4c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.775209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.776514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.776858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.777201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.778127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:38.778499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.780105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.793147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 288/584] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:38.793147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.808784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.809361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.809634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.809903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.811896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.818106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.819781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.822729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:38.832664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:38.833844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 297/585] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:38.840097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.908468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c1111-5acd-4997-a8ff-361c39d0ddca None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.940469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcf95-f78f-4f5d-b09c-856edaa1bf5b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:38.943204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.943826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.944106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.944379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.945122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:38.945432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.946882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:38.965339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 289/586] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:38.965339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:38.980439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:38.981098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:38.981379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:38.981656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:38.993124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:38.995314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:39.009295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:39.010746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:39.011712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:39.011712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:39.011712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:39.011712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:39.011712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 298/587] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:39.011992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.058479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.063349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.075678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc694-59a6-4c40-a6f1-f972d80140c4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.115370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.116162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.116439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.116740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.119762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b18157-9f5f-4b75-af3a-634392abc255 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.127908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.129506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:39.147595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:39.148732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:39.155132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:39.155132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:39.155132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:39.155132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:39.155132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 290/588] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:39.155132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.162421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.163078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.163361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.163635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.164434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:39.164785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.166804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.191086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 299/589] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:39.191086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.271996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881a0e-08ff-4a7f-8dd7-e1eafe3be415 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.298339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731817e2-eeb6-4b00-bf77-5d1994423ac3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.302335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.307440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.308169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.308457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.308728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/2f49e424f08d40c5880a8ce3ca1cac59/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.312798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.325568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=2f49e424f08d40c5880a8ce3ca1cac59, role_id=04bcfbb7bd794ed2bc75b6228f5c4ae9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.326992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.341378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 291/590] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:24:39 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/2f49e424f08d40c5880a8ce3ca1cac59/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:39.342344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.352026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.352929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.353362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.354098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.356008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:39.356541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.358133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.374556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 300/591] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:39.375812 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.468356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afbe5-2328-44d7-a92b-7b5ba483718b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.507366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.508174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.508667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.509042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.510439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:39.510856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.511700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fda491-29f3-41d9-8dee-74cf09f72cce None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.512671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.528763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 292/592] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:39.530165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.560857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.561515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.561800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.562073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.573608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.575112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.584972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:39.591831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:39.593176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:39.594304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:39.594304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:39.594304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:39.594304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:39.595421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 301/593] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:39.596287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.615392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.661526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7a1a-0416-44f0-aba7-f84c94fe40cf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.699571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.700503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.700948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.701381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.709067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.710771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:39.723558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:39.724641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:39.725789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:39.727920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 293/594] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:39.729004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.731027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007b4f-f539-422f-b06d-cddb9c670e78 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.777728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.778620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.779106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.779528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.789725 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.791536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:39.804178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:39.805295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 18:24:39.806464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:39.809360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 302/595] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:39.810476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.861304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41f2b7-46ef-48c4-a611-ec1aa11373a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.868830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.899392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.900294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.901247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.901836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.902691 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:39.903193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.904782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:39.906123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:39.919674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 294/596] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:39.920874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:39.941969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb946c-c103-419e-aa37-2078630b87e5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:39.984159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:39.984841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:39.985054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:39.985319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:39.986362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:39.986717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:39.988255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.007096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 303/597] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:40.008218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.046264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9a84-391d-4241-a686-4a9ceb1acc9d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.081373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.082001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.082279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.082704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.083358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:40.083658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:40.085099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.107869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 295/598] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Jul 31 18:24:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:40.108663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.125061 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d60d2-fe0a-4987-bc9d-54d3da331fde None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.137821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:40.162165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a5398-a419-46ac-87db-2bb8102722cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.162816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a5398-a419-46ac-87db-2bb8102722cb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.163123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a5398-a419-46ac-87db-2bb8102722cb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.163405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a5398-a419-46ac-87db-2bb8102722cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.166075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:40.170735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a5398-a419-46ac-87db-2bb8102722cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:40.172547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a5398-a419-46ac-87db-2bb8102722cb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-9b5a5398-a419-46ac-87db-2bb8102722cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:40.184130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:40.185233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:40.186128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 304/599] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:40.186883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08863-a116-43cd-a5fe-3793e37cfe02 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.187193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08863-a116-43cd-a5fe-3793e37cfe02 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.187466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08863-a116-43cd-a5fe-3793e37cfe02 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.188713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 305/600] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:40.192314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc08863-a116-43cd-a5fe-3793e37cfe02 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.227707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114cbb-1a48-4dc4-bd75-25a61b11c0a7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.264964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.265636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.265917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.266194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/31e9920dd81b4f0a8a28a4e8ebef2ae2/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.282022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=31e9920dd81b4f0a8a28a4e8ebef2ae2, role_id=04bcfbb7bd794ed2bc75b6228f5c4ae9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:40.283516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.297604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 296/601] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:24:40 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/31e9920dd81b4f0a8a28a4e8ebef2ae2/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:40.298388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.317518 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc08863-a116-43cd-a5fe-3793e37cfe02 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.363160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7fb50-eeb3-4fc7-8fd7-889c318bf192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.363881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7fb50-eeb3-4fc7-8fd7-889c318bf192 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.364218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7fb50-eeb3-4fc7-8fd7-889c318bf192 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.364501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7fb50-eeb3-4fc7-8fd7-889c318bf192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.381025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7fb50-eeb3-4fc7-8fd7-889c318bf192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:40.383103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7fb50-eeb3-4fc7-8fd7-889c318bf192 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c7f7fb50-eeb3-4fc7-8fd7-889c318bf192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:40.405051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:40.406044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:40.406979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:40.406979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:40.406979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:40.406979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:40.406979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 306/602] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:40.407905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee66c5-000c-440a-b491-c9b01e3b92b4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.408193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee66c5-000c-440a-b491-c9b01e3b92b4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.408466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee66c5-000c-440a-b491-c9b01e3b92b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.410870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:40.431637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d5ee66c5-000c-440a-b491-c9b01e3b92b4 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:40.433040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d5ee66c5-000c-440a-b491-c9b01e3b92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:40.460832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eb731-2944-4551-abee-fc696126006c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.493248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:40.510976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.510976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.510976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.510976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.511417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:40.511940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:40.514360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.529022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 297/604] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:40.529210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 307/604] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:40.530087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.538661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee66c5-000c-440a-b491-c9b01e3b92b4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.659959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e013445-c606-43e9-b1bf-0311112a8a42 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.674639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee66c5-000c-440a-b491-c9b01e3b92b4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.704774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.705726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.706338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.706730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.707722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:40.708034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:40.709443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.711071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:40.722358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.723353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.723860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.724336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/b9970bd7f09446339fb291e591cdfbfb/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.728419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 298/605] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:40.729697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.743773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=b9970bd7f09446339fb291e591cdfbfb, role_id=04bcfbb7bd794ed2bc75b6228f5c4ae9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:40.746338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:40.767202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 308/606] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:24:40 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/b9970bd7f09446339fb291e591cdfbfb/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:24:40.772795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:40.838371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:40.875293 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07026a-806a-4254-bffb-8f07bb3357aa None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.941617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c385fd-40ae-4957-bc95-ee4febf6a28c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:40.948276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:40.949342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:40.949846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:40.950328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:40.973094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:40.984222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:40.985197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:40.986276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:40.989152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 299/607] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:40.997585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.008458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:41.009796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.010466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.010919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.019630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:41.021370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:41.034481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:41.035453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:41.036427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:41.038540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 309/608] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:41.045703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.063146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:41.111204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e04f-646c-4cb2-87cf-700056e36974 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.147088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:41.147887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.148261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.148464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:41.148713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.149841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:41.149841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:41.152053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:41.161055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 300/609] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:41.168070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.170154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3252b3-4052-471b-b8b9-87b3eb32a067 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.238976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:41.239972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.240393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.240804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.241711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:41.242176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:41.243906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:41.257000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 310/610] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:41.263283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.377201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fa6d6-3d8e-47aa-ba63-b16d1c3f7fd0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.424790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:41.430737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8cac-b50a-4e1f-96b7-eb701a308b18 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.470873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b90165-a95c-4980-b333-b97769ae4127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:41.471836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90165-a95c-4980-b333-b97769ae4127 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.472257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90165-a95c-4980-b333-b97769ae4127 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.472697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90165-a95c-4980-b333-b97769ae4127 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/235416b3ebfc42f48be079760f271fae/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.489688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b90165-a95c-4980-b333-b97769ae4127 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=235416b3ebfc42f48be079760f271fae, role_id=04bcfbb7bd794ed2bc75b6228f5c4ae9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:41.491363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b90165-a95c-4980-b333-b97769ae4127 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:41.498440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:41.499232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.499516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.499808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.503494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:41.513432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 311/611] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:24:41 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/235416b3ebfc42f48be079760f271fae/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:41.513432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2c49-564e-4e26-bbf2-c976a94bd2b7 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.513432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2c49-564e-4e26-bbf2-c976a94bd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.513432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2c49-564e-4e26-bbf2-c976a94bd2b7 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.513432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 312/612] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:41.520067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75e82-3cab-451d-8be6-617a26eace58 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.520456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75e82-3cab-451d-8be6-617a26eace58 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.520793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75e82-3cab-451d-8be6-617a26eace58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.521629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:41.523353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:41.543203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2cb75e82-3cab-451d-8be6-617a26eace58 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:41.544582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2cb75e82-3cab-451d-8be6-617a26eace58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:41.547847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:41.548749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:41.549882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:41.549882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:41.549882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:41.549882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:41.557325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 301/613] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:41.558622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.630252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 313/614] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:41.656521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75e82-3cab-451d-8be6-617a26eace58 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.779134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6692d-a67d-408f-80db-3535a25a1f58 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.793627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75e82-3cab-451d-8be6-617a26eace58 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.819634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:41.820610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.821076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.821570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.822421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:41.823881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:41.824374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:41.826194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:41.831678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:41.832346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:41.832612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:41.832887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:41.844287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:41.845168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 302/615] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:41.849303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:41.850221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:41.851080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 314/616] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:41.856484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.857508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:41.887270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:41.963717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac37bf2-84b0-49f4-b3e1-7da7a1f11b05 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.993800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8754-19ee-442e-b6b8-74de07cc53f0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:41.999390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.000139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.000521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.000897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.001737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:42.002184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.003723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.017380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 315/617] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:42.018789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.061079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.061675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.061950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.062217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.075283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:42.078700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.080207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:42.109220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:42.110246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:42.111215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 303/618] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:42.118087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.126997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28aefb-e559-4e81-8f8c-6216581f5f1c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:42.162896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.163585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.163852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.164127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.175746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.177497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:42.193607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:42.194560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:42.195642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:42.195642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:42.195642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:42.195642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:42.199040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 316/619] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:42.204093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.305024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:42.333222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdcfc-a238-40c6-9c5c-642e4d4cd1e0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:42.390182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.390820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.391111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.391378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.392235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:42.392537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.394187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.405085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aafed-e52c-4dc4-a270-adbd067196d6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:42.408334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:42.434540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 304/620] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:42.442317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.477054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.477675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.477952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.478260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.479865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:42.480176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.481551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.500146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 317/621] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:42.505283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.618818 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8b18-42dc-4c59-bb00-35e706c944eb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:42.653705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd546c-95be-41dd-963b-81a38ddddbc8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:42.666503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c268c18-f074-4b01-bd6b-ec02ead9ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.667279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c268c18-f074-4b01-bd6b-ec02ead9ad97 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.667621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c268c18-f074-4b01-bd6b-ec02ead9ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.667991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c268c18-f074-4b01-bd6b-ec02ead9ad97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.678768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c268c18-f074-4b01-bd6b-ec02ead9ad97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.680418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c268c18-f074-4b01-bd6b-ec02ead9ad97 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.688634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:42.697896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93b36b-d481-4034-b5ca-c5ef5cbe0a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5c268c18-f074-4b01-bd6b-ec02ead9ad97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:42.698411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:42.699339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:42.700237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:42.700237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:42.700237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:42.700237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:42.701259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b36b-d481-4034-b5ca-c5ef5cbe0a4a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.701758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b36b-d481-4034-b5ca-c5ef5cbe0a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.702220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b36b-d481-4034-b5ca-c5ef5cbe0a4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.704463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 305/622] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:42.705818 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366130fa-0b45-4d29-9d05-02987fd3da2d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.706104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366130fa-0b45-4d29-9d05-02987fd3da2d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.706376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366130fa-0b45-4d29-9d05-02987fd3da2d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.707941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 306/623] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:42.708630 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366130fa-0b45-4d29-9d05-02987fd3da2d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.711312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93b36b-d481-4034-b5ca-c5ef5cbe0a4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.713646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93b36b-d481-4034-b5ca-c5ef5cbe0a4a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4d93b36b-d481-4034-b5ca-c5ef5cbe0a4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:42.728652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:42.729674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 18:24:42.730639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:42.732390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 318/624] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:42.737540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7ce4-1c7f-4407-8fb8-69c2a37f3580 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.737540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7ce4-1c7f-4407-8fb8-69c2a37f3580 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.737540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7ce4-1c7f-4407-8fb8-69c2a37f3580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.763087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-21bc7ce4-1c7f-4407-8fb8-69c2a37f3580 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:42.765393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-21bc7ce4-1c7f-4407-8fb8-69c2a37f3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:42.789012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:42.841843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366130fa-0b45-4d29-9d05-02987fd3da2d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:42.855199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 319/625] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:42.856188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7ce4-1c7f-4407-8fb8-69c2a37f3580 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.881774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:42.882682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:42.883545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:42.883999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:42.885614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:42.886280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:42.888030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:42.905784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 307/626] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:42.907073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:42.980728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:42.997230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7ce4-1c7f-4407-8fb8-69c2a37f3580 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.028720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c666-9bd6-45bb-a137-b5fec4a6228a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.042878 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.044349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.045241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.045665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.046880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:43.047350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.049508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.067526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.068530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.068877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.069246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.078233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 320/627] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:43.078233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.084982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:43.090668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:43.091660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:43.092592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:43.097049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 308/628] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:43.097874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:43.098853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.213295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73272048-2ad7-4109-9399-771599224ea6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.215220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc4b4-f418-4209-9f91-56df9cc31353 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.238357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:43.256096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.256746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.257021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.257280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.263073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b2311-c5f6-44ea-a07d-f606c2e66999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.264209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b2311-c5f6-44ea-a07d-f606c2e66999 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.264975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b2311-c5f6-44ea-a07d-f606c2e66999 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.265445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b2311-c5f6-44ea-a07d-f606c2e66999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.265551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.267163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:43.280447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:43.281387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:43.282274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 321/629] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:43.282762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.351392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b2311-c5f6-44ea-a07d-f606c2e66999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.352967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b2311-c5f6-44ea-a07d-f606c2e66999 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.370296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:43.407102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f03d2-146a-471d-8b75-bf74fcd3afb9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.445544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.446167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.446443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.446715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.447560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:43.447861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.449237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.457509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 322/630] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:43.458042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.469256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 309/631] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:43.471314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eb3e2-d909-4815-b4a1-556c18b90957 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.471694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eb3e2-d909-4815-b4a1-556c18b90957 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.472537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eb3e2-d909-4815-b4a1-556c18b90957 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.474095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 310/632] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:43.474808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eb3e2-d909-4815-b4a1-556c18b90957 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.494983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:43.573215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e600ae-0ea0-41f0-ad4c-47731f160ff7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.580789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eb3e2-d909-4815-b4a1-556c18b90957 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.606831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:43.613399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.614088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.614435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.614772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.615614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:43.615986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.616126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ea502-c07a-4453-b544-6a457008c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.616755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea502-c07a-4453-b544-6a457008c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.617030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea502-c07a-4453-b544-6a457008c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.617298 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea502-c07a-4453-b544-6a457008c2e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.617705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.628807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ea502-c07a-4453-b544-6a457008c2e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.635535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ea502-c07a-4453-b544-6a457008c2e4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.635734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 323/633] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:43.635734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1a9ea502-c07a-4453-b544-6a457008c2e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:43.651610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:43.652730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:43.653827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:43.653827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:43.653827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:43.653827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:43.654322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 311/634] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:43.655512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f6a1-4374-45de-80fb-ae766e580720 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.655794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f6a1-4374-45de-80fb-ae766e580720 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.656066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f6a1-4374-45de-80fb-ae766e580720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.674799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dde0f6a1-4374-45de-80fb-ae766e580720 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:43.676048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dde0f6a1-4374-45de-80fb-ae766e580720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:43.741355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:43.751178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f843676-7e2c-469b-ae22-ee8ef6974904 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.755393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 312/635] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:43.762982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f6a1-4374-45de-80fb-ae766e580720 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.791043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.791988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.792335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.792684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.803035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.804516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:43.819080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:43.820191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:43.826265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:43.826265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:43.826265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:43.826265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:43.826265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 324/636] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:43.826265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.871356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:43.876628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f6a1-4374-45de-80fb-ae766e580720 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.913045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.913717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.913996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.914272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/25905fe87291438aa787ecada5cb6865/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.928621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=25905fe87291438aa787ecada5cb6865, role_id=04bcfbb7bd794ed2bc75b6228f5c4ae9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.930070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.931445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947f73-6dfd-42da-989c-666dcaa77407 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:43.943590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 313/637] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:24:43 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/25905fe87291438aa787ecada5cb6865/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:43.944380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:43.967936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:43.968588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:43.968931 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:43.969211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:43.969954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:43.970264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:43.971746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:43.985364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 325/638] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:43.986225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.003311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.062183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67dd8c-a5db-4e18-b510-1d7282ac3dc4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.103863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1763-602f-41a0-9e89-695767b7e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.104584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1763-602f-41a0-9e89-695767b7e514 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.104864 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1763-602f-41a0-9e89-695767b7e514 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.105044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c8ba-2826-473d-b514-3b5237daec55 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.105448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1763-602f-41a0-9e89-695767b7e514 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.107494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.120565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1763-602f-41a0-9e89-695767b7e514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-779e1763-602f-41a0-9e89-695767b7e514 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:44.125457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:44.126395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:44.127338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 314/639] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:44.128053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dbc1a-703c-4159-8b7b-7c4352b6cbed None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.128743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dbc1a-703c-4159-8b7b-7c4352b6cbed None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.128743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dbc1a-703c-4159-8b7b-7c4352b6cbed None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.133981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 315/640] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:44.133981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0dbc1a-703c-4159-8b7b-7c4352b6cbed None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.152132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.152758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.153032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.153299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.153984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:44.154286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.155690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.167706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 326/641] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:44.168505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.244412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0dbc1a-703c-4159-8b7b-7c4352b6cbed None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.256077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.274890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dbfa-391b-48a1-8961-c0b371fb1afd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.282264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13398d1-395b-436f-89d9-d15bfabcbd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.283470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13398d1-395b-436f-89d9-d15bfabcbd94 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.283879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13398d1-395b-436f-89d9-d15bfabcbd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.284255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13398d1-395b-436f-89d9-d15bfabcbd94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.291705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13398d1-395b-436f-89d9-d15bfabcbd94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.293259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13398d1-395b-436f-89d9-d15bfabcbd94 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f13398d1-395b-436f-89d9-d15bfabcbd94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:44.305064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:44.307062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 316/642] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb572c9-13d5-48b2-a6b1-d1f0864e511b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.308553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb572c9-13d5-48b2-a6b1-d1f0864e511b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.309290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb572c9-13d5-48b2-a6b1-d1f0864e511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.317343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.318089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.318473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.318850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.319694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:44.320098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.321560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.327714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fbb572c9-13d5-48b2-a6b1-d1f0864e511b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:44.328889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fbb572c9-13d5-48b2-a6b1-d1f0864e511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:44.335627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 327/643] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:44.335627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.363314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.406985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 317/644] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:44.406985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb572c9-13d5-48b2-a6b1-d1f0864e511b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.460931 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beea01a-e459-48b4-adaa-0b5cc9dce118 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.498951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.499787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.500071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.500343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.507466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.508858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.516928 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.519750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb572c9-13d5-48b2-a6b1-d1f0864e511b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:44.522127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:44.523047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 328/645] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:44.524141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.565547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.566558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.567100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.567604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.568596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:44.569516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.571596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.596615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 318/646] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:44.596615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.618590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.635951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530002-ebfd-42c5-9e5f-75b2cae8cb44 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.671706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.673101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.673383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.673657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.685631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.687112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:44.702351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:44.703554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:44.704668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:44.704668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:44.704668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:44.704668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:44.705088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178daef0-37a5-45d1-b11a-728744b9ba2a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.708199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 329/647] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:44.708998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.743176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.743823 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.744277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.744593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.755095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:44.760560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:44.761679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 319/648] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:44.762732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.782582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.825130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0a0b-0670-4f70-a366-6f9240e6d4b7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.860682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.861309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.861950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.862416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.863325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:44.863637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.865787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.867427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b827a49-4482-4727-8c00-d0a7373f0619 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.875043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:44.886217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 330/649] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:44.886217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:44.909002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:44.909732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:44.910081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:44.910419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:44.977669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:44.979885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:44.991654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086dc4-08ea-4802-a6f4-de25d03e30f7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:44.998087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.029225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.029825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.030108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.030375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.031086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:45.031390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.032753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.050523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 331/650] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:45.050523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.094343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 320/651] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:45.094343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.116648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.161889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ff53a-c7d7-4fd9-a261-5a1967409066 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.196838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268dddb-56ea-460d-8744-7e46c3c53842 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.198973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.199603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.199879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.200148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.200851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:45.201154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.202523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.210792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 332/652] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:45.211619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.219220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.237576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.238188 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.238469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.238745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.239565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=2f49e424f08d40c5880a8ce3ca1cac59) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:45.239871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.241319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.247734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 321/653] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/role_assignments?user.id=2f49e424f08d40c5880a8ce3ca1cac59&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:45.248354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.340145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719963f1-3645-49db-b27e-bb7012197154 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.363452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea514c6-f639-4eca-9d20-5db7d82053e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.365708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.385279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.386513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.387062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.387542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.397871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.400081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.402163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.402475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.402853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.403296 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.416791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:45.417514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:45.418511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:24:45.419944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:45.420494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.420568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 333/654] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:45.420568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:45.437424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:45.438343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:45.443664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:45.443664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:45.443664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:45.443664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:45.443664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 322/655] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:45.443664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.484401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.564320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2d28-8ea9-48f9-95c1-dff5f21919e8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.568433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5df2d-ac1a-41aa-a24a-a229034db209 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.609462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.610014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.610291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.610565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.611390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:45.611692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.612102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.612986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.613155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.613619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.614098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.630139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.632080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 323/656] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:45.632456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.637605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:45.655908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:45.657084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:45.658194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:45.658194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:45.658194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:45.658194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:45.659722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 334/657] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:45.660796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.694362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.748820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.759031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d7cde-59f0-420b-a899-c37282189fbd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.774010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92cbbe-d52d-4794-9214-4c95c293f55e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.798310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.799261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.799692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.800132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.800971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:45.801422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.802962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.811457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.812226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.812618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.812990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.817920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 324/658] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:45.818894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:45.891624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.893163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.925569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:45.929151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93f791-a995-4a40-a508-9e0eda41482d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:45.966848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:45.967799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:45.968289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:45.968788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:45.969677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:45.970184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:45.971792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:45.986165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 325/659] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:45.987299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.003079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.005249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 335/660] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:46.010533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.099554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de803108-007e-4d48-852b-3de48d7468e4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.117463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238b127-3e0b-479b-b91b-2468d9cb0166 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.142381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e81e8-8899-4891-8d3a-30fd8d67a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.142995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e81e8-8899-4891-8d3a-30fd8d67a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.143268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e81e8-8899-4891-8d3a-30fd8d67a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.143537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e81e8-8899-4891-8d3a-30fd8d67a2e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.148747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.150740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e81e8-8899-4891-8d3a-30fd8d67a2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:46.152455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e81e8-8899-4891-8d3a-30fd8d67a2e6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:46.156582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.157235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.157515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.157785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-783e81e8-8899-4891-8d3a-30fd8d67a2e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:46.164727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:46.165665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:46.172574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:46.173046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:46.173135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 326/661] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:46.173213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:46.173294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7755a-06ed-4764-8a32-34cea9a34d0d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.173294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7755a-06ed-4764-8a32-34cea9a34d0d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.173294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7755a-06ed-4764-8a32-34cea9a34d0d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.173294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 327/662] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:46.173294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7755a-06ed-4764-8a32-34cea9a34d0d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:46.189565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:46.190540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 336/663] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:46.192203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.257265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.296829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7755a-06ed-4764-8a32-34cea9a34d0d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.298631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6f84-917e-48df-8207-2a69fe9c8df2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.332693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.333421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.333775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.334123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.334817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b7687-73a2-4acb-b376-c923a8c39d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.335571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7687-73a2-4acb-b376-c923a8c39d2e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.335950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7687-73a2-4acb-b376-c923a8c39d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.336362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7687-73a2-4acb-b376-c923a8c39d2e None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.337255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b7687-73a2-4acb-b376-c923a8c39d2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:46.337514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b7687-73a2-4acb-b376-c923a8c39d2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:46.339664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b7687-73a2-4acb-b376-c923a8c39d2e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:46.345483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:46.347103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:46.358385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 337/664] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:46.358385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b66f4-448e-4c19-baac-02465b5fa199 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.358385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b66f4-448e-4c19-baac-02465b5fa199 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.358385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b66f4-448e-4c19-baac-02465b5fa199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:46.367545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:46.368667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:46.369743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:46.369743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:46.369743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:46.369743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:46.369743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 328/665] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:46.370047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.377383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fc2b66f4-448e-4c19-baac-02465b5fa199 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:46.378811 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fc2b66f4-448e-4c19-baac-02465b5fa199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:46.428515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.452679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 338/666] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:46.463109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b66f4-448e-4c19-baac-02465b5fa199 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.509152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93dce7-3e39-41fc-95c7-71e5392032ba None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.535118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.547448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.548072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.548358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.548628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.549429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:46.549737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:46.551212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:46.564874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b66f4-448e-4c19-baac-02465b5fa199 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.575408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 329/667] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:46.575408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.600329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.600951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.601232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.601505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.602314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:46.602774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:46.604832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:46.618963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 339/668] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/role_assignments?user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:46.618963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.677432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.698692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088a1e2-2d48-497e-a933-08bf46133db4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.738050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.738686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.739003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.739285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.739993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:46.740301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:46.741713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:46.754452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 330/669] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:46.755359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.756375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584613f5-eeb5-4ceb-a82e-5bdc40e3640f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.803987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.807048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.808124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.808634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.809490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.826848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:46.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:46.833593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:46.834462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:46.835360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 340/670] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:46.836189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:46.884105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b6dd-c037-4bee-8e01-2d285f07cbbe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.925475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.926123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.926386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.926660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:46.961352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291645d-b43a-4d63-ae7f-a4bd0d2dbaa3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:46.969463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:46.998490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:46.999277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:46.999617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:46.999955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.006969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.008622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.017568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.019060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:47.020941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:47.021822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:47.022732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:47.026913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 341/671] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:47.027845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.079306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:47.143958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 331/672] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:47.145071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.152828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab88f-8a6a-4203-ac93-efb6b159ff88 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.196063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.196830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.197317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.197680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.198547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:47.198957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.200455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.209490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 342/673] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:47.210447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.248615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:47.257932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298399-92b1-4809-b7ad-f959fb4d9cca None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.294679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7823-30da-478d-830f-a409f27409af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.295488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7823-30da-478d-830f-a409f27409af None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.295861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7823-30da-478d-830f-a409f27409af None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.296442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7823-30da-478d-830f-a409f27409af None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.297059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7823-30da-478d-830f-a409f27409af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:47.297474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7823-30da-478d-830f-a409f27409af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.299029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7823-30da-478d-830f-a409f27409af None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.313236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 332/674] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:47.314290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7823-30da-478d-830f-a409f27409af None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.320703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:47.347107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dec2e-97d9-4d3c-add4-a372036b10c2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.383763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.384596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.384907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.385250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.397679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.399314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:47.415223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:47.416249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:47.417147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:47.417147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:47.417147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:47.417147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:47.421584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 343/675] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:47.422545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.448265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7823-30da-478d-830f-a409f27409af None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.487303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a9fde-a654-4611-9fcc-9639e6a18511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.487951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a9fde-a654-4611-9fcc-9639e6a18511 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.488227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a9fde-a654-4611-9fcc-9639e6a18511 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.488501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a9fde-a654-4611-9fcc-9639e6a18511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.500538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a9fde-a654-4611-9fcc-9639e6a18511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.501924 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a9fde-a654-4611-9fcc-9639e6a18511 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.514596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-202a9fde-a654-4611-9fcc-9639e6a18511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:47.516489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:47.517581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:47.519149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:47.519149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:47.519149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:47.519149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:47.522133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 333/676] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:47.523414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632329b-a486-4a75-89c7-5479433d6dd2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.523699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632329b-a486-4a75-89c7-5479433d6dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.523973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632329b-a486-4a75-89c7-5479433d6dd2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.525318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 334/677] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:47.529925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632329b-a486-4a75-89c7-5479433d6dd2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.538720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4398e-8573-4d08-8c57-ac182dc04f5b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.574555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.575500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.575500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.575743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.576511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=b9970bd7f09446339fb291e591cdfbfb) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:47.576814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.578370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.590978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 344/678] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/role_assignments?user.id=b9970bd7f09446339fb291e591cdfbfb&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:47.590978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.595159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:47.655304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632329b-a486-4a75-89c7-5479433d6dd2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.693280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719e8a7-88ce-4eee-8666-f735feea1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.693922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e8a7-88ce-4eee-8666-f735feea1e2d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.694202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e8a7-88ce-4eee-8666-f735feea1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.694475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e8a7-88ce-4eee-8666-f735feea1e2d None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.695202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719e8a7-88ce-4eee-8666-f735feea1e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:47.695508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719e8a7-88ce-4eee-8666-f735feea1e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.697471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719e8a7-88ce-4eee-8666-f735feea1e2d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.711264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 335/679] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:47.712571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632faf79-8255-428d-b893-1c53ba8b140e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.713525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632faf79-8255-428d-b893-1c53ba8b140e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.713769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632faf79-8255-428d-b893-1c53ba8b140e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.731563 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0949d-716e-457c-b376-785d5b08e21c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.733833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-632faf79-8255-428d-b893-1c53ba8b140e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:47.735317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-632faf79-8255-428d-b893-1c53ba8b140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:47.776009 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.776739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.777108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.777589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.778315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:47.778714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.780304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.793762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 345/680] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:47.795749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.799573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:47.827837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 336/681] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:47.828760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632faf79-8255-428d-b893-1c53ba8b140e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:47.882528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:47.926474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218afc-2909-4057-9e7d-c394526fe7d8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.953070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632faf79-8255-428d-b893-1c53ba8b140e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:47.974792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.976256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.976846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.977373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:47.988129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:47.989962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:47.991302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:47.992106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:47.992381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:47.992732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.002497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:48.005073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:48.006166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:48.007290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:48.010179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 346/682] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:48.011480 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:48.026133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:48.027467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:48.028667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:48.030378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 337/683] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:48.035523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.096044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:48.144639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e0be-af03-4cf9-9605-e6ffb335ab0d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.148103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:48.150970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535de6-18bc-4c25-a56f-ba662d9b5423 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.183220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.184197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.184346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.184722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.185594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:48.186005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.187797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.193101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.194268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.194695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.195140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.201817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 338/684] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:48.202843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.211972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.213708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:48.229576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:48.230730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:48.231872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:48.231872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:48.231872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:48.231872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:48.233399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 347/685] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:48.234320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.336746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774636e9-b42e-45d1-b5cc-75408875c045 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.347446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a76aa-d1f4-421c-ac51-93f39d4d6d8c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.365446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:48.386139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.386598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.387212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.387462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.387823 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.387952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.388294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.388515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.389529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=235416b3ebfc42f48be079760f271fae) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:48.389871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:48.389984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.390420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.392207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.392487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.400991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 348/686] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:48 2022] GET /identity/v3/role_assignments?user.id=235416b3ebfc42f48be079760f271fae&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:48.402385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.418318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 339/687] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Jul 31 18:24:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:48.428294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.460454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:48.560294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1ed35-b8f6-4e9d-abed-4243e7afd011 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.603022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.604254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.604512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.604790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.639119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c523f0-9d96-4cdb-a24c-c217a34693d7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.674211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.675216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.675696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.676187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.677067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:48.677582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.679177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.680241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.682408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.697780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 349/688] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:48.699475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.708143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:48.744773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:48.801186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 340/689] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:48.806764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:48.818477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1a0a-a9b0-46c9-93cb-5b84f015ce26 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.854245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66335c1-bc22-4178-a12a-51866b857411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.854804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66335c1-bc22-4178-a12a-51866b857411 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.855118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66335c1-bc22-4178-a12a-51866b857411 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.855390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66335c1-bc22-4178-a12a-51866b857411 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.856083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66335c1-bc22-4178-a12a-51866b857411 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.857573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66335c1-bc22-4178-a12a-51866b857411 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.886629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 350/690] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:24:48 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:24:48.919080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36fc83-8200-4fdd-8392-974a54523e8c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:48.945963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:48.958500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:48.959209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.959490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.959761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.966644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e9842-be9d-46ff-be4a-96c92aa5c1ed None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.967097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e9842-be9d-46ff-be4a-96c92aa5c1ed None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.967473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e9842-be9d-46ff-be4a-96c92aa5c1ed None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.970113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 351/691] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:48.974114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:48.975906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:48.976594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91bd07-f3ae-48df-b38f-7b024067693e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:48.976921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91bd07-f3ae-48df-b38f-7b024067693e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:48.977416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91bd07-f3ae-48df-b38f-7b024067693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:48.999802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1e91bd07-f3ae-48df-b38f-7b024067693e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:49.000969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:49.001888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:49.002802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:49.002802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:49.002802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:49.002802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:49.003050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1e91bd07-f3ae-48df-b38f-7b024067693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:49.004955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 341/692] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:49.012746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.091911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 352/693] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:49.117748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91bd07-f3ae-48df-b38f-7b024067693e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.151243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:49.209903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c4b9d-80f2-4ea2-a711-67cd99ac7cce None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:49.251902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:49.252533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:49.252812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:49.253083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:49.253561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91bd07-f3ae-48df-b38f-7b024067693e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:49.253989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:49.254067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:49.256294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:49.269848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 342/694] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:49.276755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.300990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:49.302002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:49.302489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:49.303011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:49.318074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:49.318886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:49.325415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:49.326395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:49.327305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:49.330426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 353/695] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:49.337037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.410749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f28ba5-2661-4502-a92a-f8f6f64777c9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:49.463356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:49.471599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:49.473062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:49.473352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:49.473625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:49.476511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a811f8-23d3-4b25-bf7d-e310ded3c2cb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:49.492925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:49.496626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:49.522465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:49.523477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:49.524394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:49.535709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 343/696] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:49.536870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.547983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:49.548614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:49.548891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:49.549158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:49.549876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:49.550176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:49.551587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:49.571364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 354/697] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:49.578392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.711345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac416-9d25-4752-9815-c87c9f5a2701 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:49.715387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:49.751528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:49.752456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:49.752736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:49.753006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:49.753757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:49.754063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:49.755560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:49.769702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 344/698] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:49.776771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.803003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97948645-47f0-4a57-bac7-afbfc6a863e7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:49.845337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:49.846153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:49.846444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:49.846724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:49.859066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:49.860573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:49.876506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:49.877455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:49.878373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:49.878373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:49.878373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:49.878373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:49.878373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 355/699] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:49.879432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:49.883795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:49.979780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867bc14-45c9-4313-b11e-d4f5ccf415c3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:50.006900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152c5ce-7abe-4291-b106-91181575694c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:50.016260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e59bc-604f-49d5-948a-5eb8ddda8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:50.016889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e59bc-604f-49d5-948a-5eb8ddda8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.017169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e59bc-604f-49d5-948a-5eb8ddda8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.017444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e59bc-604f-49d5-948a-5eb8ddda8bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.018225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e59bc-604f-49d5-948a-5eb8ddda8bd3 None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=25905fe87291438aa787ecada5cb6865) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:50.018534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e59bc-604f-49d5-948a-5eb8ddda8bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:50.020022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e59bc-604f-49d5-948a-5eb8ddda8bd3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:50.026699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 345/700] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/role_assignments?user.id=25905fe87291438aa787ecada5cb6865&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:50.028084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f41eb-d7c4-41c1-ae88-8868fbdcf0c3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.028370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f41eb-d7c4-41c1-ae88-8868fbdcf0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.028643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f41eb-d7c4-41c1-ae88-8868fbdcf0c3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.034189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 346/701] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:50.035866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74870-0a98-4f04-8850-70d692c4ece8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.036156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74870-0a98-4f04-8850-70d692c4ece8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.036437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74870-0a98-4f04-8850-70d692c4ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.060646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-05d74870-0a98-4f04-8850-70d692c4ece8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:50.062286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-05d74870-0a98-4f04-8850-70d692c4ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:50.065339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:50.066077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.066458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.066836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.067675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:50.068086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:50.069617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:50.091876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 356/702] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:50.093718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:50.097040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:50.210140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:50.217791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 347/703] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:50.264134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74870-0a98-4f04-8850-70d692c4ece8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:50.269855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32a92-c01a-463b-8aa8-bcae75525a6d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:50.319226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:50.319880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.320324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.320607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.330754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:50.332509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:50.350593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:50.351637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:50.352687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 357/704] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:24:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:50.358312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:50.386407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74870-0a98-4f04-8850-70d692c4ece8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:50.429356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:50.430293 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.430573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.430845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.432413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:50.434837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:50.450271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:50.452712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:24:50.454717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:50.463130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 348/705] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Jul 31 18:24:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:50.463130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:50.482079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:50.497632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172856-62bc-44fe-849d-cffff40ce812 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:50.532560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:50.554508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:50.555165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.555448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.556022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.558157 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:50.558476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:50.559960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:50.595689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbf27-d6be-4bf4-a721-9330615a1289 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:50.642475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:50.643160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.643441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.643714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.644412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:50.644715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:50.646300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:50.656773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 349/706] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Jul 31 18:24:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:50.657960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:50.746663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 358/707] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:24:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:50.751366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:50.820321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:50.866414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a079-7e20-4b97-8284-96ae05e457be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:50.919428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3a3ed-8d67-4bc6-ad35-8b1472216b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:50.920057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3a3ed-8d67-4bc6-ad35-8b1472216b95 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:50.920335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3a3ed-8d67-4bc6-ad35-8b1472216b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:50.920611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3a3ed-8d67-4bc6-ad35-8b1472216b95 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:50.921289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3a3ed-8d67-4bc6-ad35-8b1472216b95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:50.922202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3a3ed-8d67-4bc6-ad35-8b1472216b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:50.923775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3a3ed-8d67-4bc6-ad35-8b1472216b95 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:50.930159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 350/708] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Jul 31 18:24:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:50.954036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5d70-143b-4429-bd63-023f9ae6f4e6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:51.000604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4459-43fd-42dc-9262-93680e0a05d0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.000913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4459-43fd-42dc-9262-93680e0a05d0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.001566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4459-43fd-42dc-9262-93680e0a05d0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.003401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 351/709] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:51.010242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27edfdd-bd7c-4de8-82e7-46814d60b0f0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.010242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27edfdd-bd7c-4de8-82e7-46814d60b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.010242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27edfdd-bd7c-4de8-82e7-46814d60b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.016620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:51.017254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.017532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.017801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.038981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c27edfdd-bd7c-4de8-82e7-46814d60b0f0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:51.038981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c27edfdd-bd7c-4de8-82e7-46814d60b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:51.123643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:51.151566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:51.153218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:51.158755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 352/710] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:51.182697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27edfdd-bd7c-4de8-82e7-46814d60b0f0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:51.276614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:51.286202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 359/711] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:51.292031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:51.313025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27edfdd-bd7c-4de8-82e7-46814d60b0f0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:51.352274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:51.353929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.354271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.354494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.355159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:51.356809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:51.369441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:51.370530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:51.371471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:51 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:51.379251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:51.410796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:51.485083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178b80-6a7a-48d1-8462-e73422a0dced None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:51.499669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9a8c-020c-459e-810c-6c0ffc448874 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:51.535738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6f22-36f4-4458-a997-8c29291e6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:51.536624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6f22-36f4-4458-a997-8c29291e6270 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.537280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6f22-36f4-4458-a997-8c29291e6270 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.537561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6f22-36f4-4458-a997-8c29291e6270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.543067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd98cfe-8582-4ba2-a102-5584c190936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:51.543695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd98cfe-8582-4ba2-a102-5584c190936c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.543980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd98cfe-8582-4ba2-a102-5584c190936c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.544256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd98cfe-8582-4ba2-a102-5584c190936c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.544960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd98cfe-8582-4ba2-a102-5584c190936c None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:51.545757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd98cfe-8582-4ba2-a102-5584c190936c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:51.547688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd98cfe-8582-4ba2-a102-5584c190936c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:51.549175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:51.549832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6f22-36f4-4458-a997-8c29291e6270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:51.551832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6f22-36f4-4458-a997-8c29291e6270 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:51.553830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 354/713] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:24:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:51.555556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf877-f9ab-475e-b5b6-40747f2247e7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.556038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf877-f9ab-475e-b5b6-40747f2247e7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.556631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf877-f9ab-475e-b5b6-40747f2247e7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.558361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 355/714] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:51.563817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf877-f9ab-475e-b5b6-40747f2247e7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a7ab6f22-36f4-4458-a997-8c29291e6270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:51.575546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:51.577776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 360/715] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565eaef-2693-4407-98e3-280a7f0f6109 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565eaef-2693-4407-98e3-280a7f0f6109 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.579998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565eaef-2693-4407-98e3-280a7f0f6109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.601910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3565eaef-2693-4407-98e3-280a7f0f6109 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:51.604050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3565eaef-2693-4407-98e3-280a7f0f6109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:51.679377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 361/716] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:51.680189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565eaef-2693-4407-98e3-280a7f0f6109 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:51.690820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf877-f9ab-475e-b5b6-40747f2247e7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:51.726350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:51.727030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.727353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.727624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.728409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:51.728754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:51.730166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:51.736164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 356/717] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:24:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:51.737111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:51.774461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:51.819850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565eaef-2693-4407-98e3-280a7f0f6109 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:51.829104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:51.884237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:51.884929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.885203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.885468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:51.886173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:51.886471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:51.887981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:51.906013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 362/718] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:51.907366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:51.912281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19972b-d6ca-4da6-a368-7a76d1a03630 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:51.974811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:51.975808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:51.976273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:51.976725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.003453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:52.010056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:52.011157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:52.012039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 357/719] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:52.017703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:52.034000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de67f6e-d0af-4303-977a-50802b6b5b4c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:52.061038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:52.095585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:52.096545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.097003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.097481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.108985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:52.112277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:52.132892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:52.133848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:52.135522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:52.138014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 363/720] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:52.151547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:52.170891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e1b1-93e5-452b-b704-4b8270c60096 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:52.207843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:52.222975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:52.222975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.222975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.222975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.223373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:52.223373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:52.223373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:52.233315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 358/721] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:52.239143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:52.336611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b379-4ee2-4136-8672-4035922cccc8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:52.379173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:52.379855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.380135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.380453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.381265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:52.381576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:52.383036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:52.396814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 364/722] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:52.410592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:52.464718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b3c8-e759-4553-b3d0-e43b60d85c94 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:52.507031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:52.516699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:52.517351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.517634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.517911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.530607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:52.532109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:52.547140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:52.548097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:52.549402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:52.549402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:52.549402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:52.549402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:52.549402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 359/723] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:52.553949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:52.598555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:52.606489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93127c1-95a1-4b95-9255-4296472e751d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:52.670626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:52.671290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.671569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.671925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.672826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:52.673146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:52.674579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:52.675635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2bd0-1483-4bf7-baff-ff747c3fc9e5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:52.687742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 365/724] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:52 2022] GET /identity/v3/role_assignments?user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:52.717787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679648a6-4a55-4953-8673-2aa2a4e614f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:52.718611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679648a6-4a55-4953-8673-2aa2a4e614f3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.718893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679648a6-4a55-4953-8673-2aa2a4e614f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.719199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679648a6-4a55-4953-8673-2aa2a4e614f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.719900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679648a6-4a55-4953-8673-2aa2a4e614f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:52.720206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679648a6-4a55-4953-8673-2aa2a4e614f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:52.721596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679648a6-4a55-4953-8673-2aa2a4e614f3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:52.736147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 360/725] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:52.741615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:52.864692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c65d-dd81-46fa-9b9b-aedbe518124d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:52.867309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:52.911768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:52.912421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.912700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.912970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.923231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:52.924684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:52.936833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:52.938983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:24:52.941643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:52.944030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1fbbb-f181-4314-bbab-2c88ecc4655d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.944030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1fbbb-f181-4314-bbab-2c88ecc4655d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.944030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1fbbb-f181-4314-bbab-2c88ecc4655d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.944030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 361/726] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:52.944895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 366/727] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:24:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:52.945036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d55d6a-f8a0-4c82-81f5-2de7476feb04 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:52.945778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d55d6a-f8a0-4c82-81f5-2de7476feb04 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:52.945778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d55d6a-f8a0-4c82-81f5-2de7476feb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:52.950954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:52.978487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d0d55d6a-f8a0-4c82-81f5-2de7476feb04 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:52.979790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d0d55d6a-f8a0-4c82-81f5-2de7476feb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:53.086378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 362/728] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 18:24:53.100769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904d18-0534-4b8d-b2e6-2703af297e26 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:53.118014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d55d6a-f8a0-4c82-81f5-2de7476feb04 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:53.144574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:53.145590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.146071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.146558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.147740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:53.148245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:53.150399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:53.171332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:53.182833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 367/729] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Jul 31 18:24:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:53.188511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:53.216815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:53.284900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d55d6a-f8a0-4c82-81f5-2de7476feb04 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:53.310774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b5c0-b9cc-47dc-9b49-f31f3a1e1922 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:53.348087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b111c-476d-4773-8003-dcbfa4dbd257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:53.348898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b111c-476d-4773-8003-dcbfa4dbd257 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.349071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b111c-476d-4773-8003-dcbfa4dbd257 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.349345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b111c-476d-4773-8003-dcbfa4dbd257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.357200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:53.357844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.358119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.358385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.369425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:53.374209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:53.375192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:53.376084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 363/730] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:53.383023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:53.471508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b111c-476d-4773-8003-dcbfa4dbd257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:53.473019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b111c-476d-4773-8003-dcbfa4dbd257 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:53.491608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:53.518333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52409f8-7301-4cc3-9445-54eb22931749 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:53.536374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:53.560092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c4e5-2f49-459f-bafb-f7fab2d6c187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:53.560735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c4e5-2f49-459f-bafb-f7fab2d6c187 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.561012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c4e5-2f49-459f-bafb-f7fab2d6c187 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.561286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c4e5-2f49-459f-bafb-f7fab2d6c187 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.562002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c4e5-2f49-459f-bafb-f7fab2d6c187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:53.562304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c4e5-2f49-459f-bafb-f7fab2d6c187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:53.563791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c4e5-2f49-459f-bafb-f7fab2d6c187 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:53.573673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 364/731] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:53.574908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9400309-9afb-42df-bcfa-3d267e452509 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.575245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9400309-9afb-42df-bcfa-3d267e452509 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.575485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9400309-9afb-42df-bcfa-3d267e452509 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.576951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 365/732] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:53.578482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9400309-9afb-42df-bcfa-3d267e452509 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:53.642650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 368/733] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 18:24:53.644019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6bfe-e6d3-491d-9cbd-9fdbfe905c09 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.644595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6bfe-e6d3-491d-9cbd-9fdbfe905c09 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.644708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6bfe-e6d3-491d-9cbd-9fdbfe905c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.664307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-afac6bfe-e6d3-491d-9cbd-9fdbfe905c09 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:53.667367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-afac6bfe-e6d3-491d-9cbd-9fdbfe905c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:53.687912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9400309-9afb-42df-bcfa-3d267e452509 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:53.724007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:53.725037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.725521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.726015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.737822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:53.739683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:53.743138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 369/734] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:53.744617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6bfe-e6d3-491d-9cbd-9fdbfe905c09 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:53.756235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:53.757132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:53.758074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:53.758074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:53.758074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:53.758074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:53.760716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:53.761150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 366/735] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:53.771048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:53.827130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:53.894006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e84c-c861-4975-9a43-a0b640ad5310 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:53.897225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6bfe-e6d3-491d-9cbd-9fdbfe905c09 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:53.936982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:53.937221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:53.937747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.938027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.938302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.938842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:53.939430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:53.939907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:53.941358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:53.941895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:53.943677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:53.951322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:53.952817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:53.965700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 367/736] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:53.965700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:53.982731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:53.983747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:53.984674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:53.984674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:53.984674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:53.984674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:53.987194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 370/737] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:53.988285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.029130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:54.070588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778a6d2-5a69-4341-a65b-47eca8bc7ad7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:54.107223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7354ce3-5909-4745-bed1-b3e1e2ef4a92 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:54.107438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:54.108036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.108285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.108555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.109248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:54.110626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:54.111442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:54.131714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 368/738] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:24:53 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:54.132677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.168566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:54.169623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.170117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.170602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.180635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:54.182648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:54.196541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:54.198324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:24:54.199862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:54.202598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 371/739] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:54.208909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.356815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dbfe8-109b-48e2-8e59-21c15426043f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:54.391060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5561f-aae1-4f73-b916-e2fdb5948586 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:54.397240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0e65-3326-4799-9f20-ab4fcb507bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:54.397872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0e65-3326-4799-9f20-ab4fcb507bbb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.398148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0e65-3326-4799-9f20-ab4fcb507bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.398841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0e65-3326-4799-9f20-ab4fcb507bbb None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.399793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0e65-3326-4799-9f20-ab4fcb507bbb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:54.400174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0e65-3326-4799-9f20-ab4fcb507bbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:54.402116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0e65-3326-4799-9f20-ab4fcb507bbb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:54.420118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:54.429179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 372/740] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Jul 31 18:24:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:54.430248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab5a2-782c-4ef0-91c2-988e4bfffef8 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.430636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab5a2-782c-4ef0-91c2-988e4bfffef8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.430812 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab5a2-782c-4ef0-91c2-988e4bfffef8 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.435492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 373/741] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:54.438689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79638bf-d755-4e6f-a0d4-f8f3f3262a67 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.438996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79638bf-d755-4e6f-a0d4-f8f3f3262a67 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.439273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79638bf-d755-4e6f-a0d4-f8f3f3262a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.449847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:54.450817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.451186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.451463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.452163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:54.452467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:54.453845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:54.467818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e79638bf-d755-4e6f-a0d4-f8f3f3262a67 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:54.469141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 369/742] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:54.469626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e79638bf-d755-4e6f-a0d4-f8f3f3262a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:54.469991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.488184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:54.548324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 374/743] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 18:24:54.549645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79638bf-d755-4e6f-a0d4-f8f3f3262a67 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.617755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3eacd-2cc9-4dcb-b075-17123ac8c6ca None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:54.654068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:54.655060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.655567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.656054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.694205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79638bf-d755-4e6f-a0d4-f8f3f3262a67 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:54.707028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:54.730085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:54.731934 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:54.740176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:54.740829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.741106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.741377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.751319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:54.753057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:54.765688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:54.766602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:54.767851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:54.770071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 375/744] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:54.771127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.783977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:54.877113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 370/745] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:24:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 18:24:54.877113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.896571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae844d6-bdf1-4ae6-a6cb-a3503a789219 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:54.932971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:54.933597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:54.933992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:54.934274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:54.934989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:54.936371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:54.953723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 376/746] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:24:54 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:24:54.954377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:54.981844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:55.015181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128568a-add5-407f-8279-c301ad659e19 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:55.045464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:55.081462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8c45-7fd6-4b87-8337-9ef5c2d0399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:55.082802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8c45-7fd6-4b87-8337-9ef5c2d0399d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.083563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8c45-7fd6-4b87-8337-9ef5c2d0399d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.084509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8c45-7fd6-4b87-8337-9ef5c2d0399d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.085826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8c45-7fd6-4b87-8337-9ef5c2d0399d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:55.086356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8c45-7fd6-4b87-8337-9ef5c2d0399d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:55.087617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf1775-6a33-408f-b525-3d459cfbb98a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:55.088586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8c45-7fd6-4b87-8337-9ef5c2d0399d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:55.108780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 371/747] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:55.110456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca527450-afe9-4eb4-a2f2-8ee86ec425ba None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.110981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca527450-afe9-4eb4-a2f2-8ee86ec425ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.111475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca527450-afe9-4eb4-a2f2-8ee86ec425ba None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.117668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 372/748] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:55.117668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca527450-afe9-4eb4-a2f2-8ee86ec425ba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:55.134861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5115e1c-3be9-4123-bd4d-3e2f38384545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:55.135434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115e1c-3be9-4123-bd4d-3e2f38384545 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.135762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115e1c-3be9-4123-bd4d-3e2f38384545 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.135985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115e1c-3be9-4123-bd4d-3e2f38384545 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.148483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5115e1c-3be9-4123-bd4d-3e2f38384545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:55.149865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5115e1c-3be9-4123-bd4d-3e2f38384545 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b5115e1c-3be9-4123-bd4d-3e2f38384545 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:55.164937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:55.166421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:55.168818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:55.168818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:55.168818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:55.168818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:55.168818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 377/749] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:55.168818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6df9-f133-4971-a76c-565c81e01872 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.169167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6df9-f133-4971-a76c-565c81e01872 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.170326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6df9-f133-4971-a76c-565c81e01872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.188590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-01ba6df9-f133-4971-a76c-565c81e01872 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:55.189784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-01ba6df9-f133-4971-a76c-565c81e01872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:55.244000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca527450-afe9-4eb4-a2f2-8ee86ec425ba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:55.274500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 378/750] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:24:55.275807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba6df9-f133-4971-a76c-565c81e01872 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:55.294776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:55.295438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.295716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.295985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.296825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=08b3612fd73644c99e1d8aeb8af68411) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:55.297081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:55.298522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:55.302127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:55.305475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 373/751] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:55 2022] GET /identity/v3/role_assignments?user.id=08b3612fd73644c99e1d8aeb8af68411&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:55.306513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:55.355234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:55.464713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba6df9-f133-4971-a76c-565c81e01872 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:55.510617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:55.511224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.511504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.511777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.512468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:55.512769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:55.513411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d854fc9-9f0e-401f-998c-06de973152db None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:55.514408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:55.529880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 379/752] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:55.536326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:55.582207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:55.583741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.584035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.584318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.604604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:55.617084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:55.618028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:55.619509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:55.624016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 374/753] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:55.630277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:55.727676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:55.770043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8ee8-4d3e-42c8-a7b3-b8ae0cc7a35e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:55.773858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf3ca-374d-459e-b337-ce58dd9a0ecb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:55.793220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:55.835458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:55.836084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.836361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.836634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.837399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:55.837895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:55.839300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:55.848488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 375/754] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:55.849128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:55.849868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:55.850152 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:55.850429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:55.854913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:55.860326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:55.861794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:55.874664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:55.875772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:55.876876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:55.880599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 380/755] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:55.881828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:55.981473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f624-c09a-4b05-9a3a-4454ca0cffce None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:56.008030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:56.026988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:56.029555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.029841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.030114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.051917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:56.054210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:56.079606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:56.082264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:56.083382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:56.083382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:56.083382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:56.083382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:56.083382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 376/756] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:56.087704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4151ae-451d-460f-90ac-570744ad174c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:56.089555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:56.123856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:56.124783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.125272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.125719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.126639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:56.127158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:56.128763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:56.142070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 381/757] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:56.151388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:56.230356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0e796-7b5e-4966-821c-788486b1a28d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:56.232302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:56.293856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:56.294396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.294674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.294955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.295648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:56.295948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:56.297325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:56.324442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 377/758] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:56.328760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:56.362148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c5430-cbdb-4cbf-aef4-d1e2ccb7311b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:56.385569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:56.423614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:56.424233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.424508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.424776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.425555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=25905fe87291438aa787ecada5cb6865) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:56.425858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:56.427317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:56.436765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 382/759] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:24:56 2022] GET /identity/v3/role_assignments?user.id=25905fe87291438aa787ecada5cb6865&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:56.488328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df3f5a-d597-4b50-8171-1a8c7cddf419 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:56.528627 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e7e20-66d8-4e6b-bcc4-7d21bdba2f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:56.529313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e7e20-66d8-4e6b-bcc4-7d21bdba2f05 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.529589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e7e20-66d8-4e6b-bcc4-7d21bdba2f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.529901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e7e20-66d8-4e6b-bcc4-7d21bdba2f05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.537921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e7e20-66d8-4e6b-bcc4-7d21bdba2f05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:56.539427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e7e20-66d8-4e6b-bcc4-7d21bdba2f05 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ed0e7e20-66d8-4e6b-bcc4-7d21bdba2f05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:56.552113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:56.553094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:56.554483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 378/760] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:24:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:56.560115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:56.687009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a59e-5cc4-443d-868d-4ccf8a3d601c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.687396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a59e-5cc4-443d-868d-4ccf8a3d601c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.687570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a59e-5cc4-443d-868d-4ccf8a3d601c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.688047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:56.689153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 379/761] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:24:56.694147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b310f-c291-4c70-9fd0-ab923dd82996 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.694428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b310f-c291-4c70-9fd0-ab923dd82996 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.694710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b310f-c291-4c70-9fd0-ab923dd82996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.694882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3621-b2c9-4931-898b-2f2268973cdd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:56.737342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f43b310f-c291-4c70-9fd0-ab923dd82996 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:56.738568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f43b310f-c291-4c70-9fd0-ab923dd82996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:56.770504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:56.771159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.771434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.771703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.772500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:56.772993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:56.776378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:56.797242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 383/762] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:24:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:56.803249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:56.892845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 380/763] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:24:56.921346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faa1d7-145f-44be-9bcb-a3708f90a5d4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:56.945612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b310f-c291-4c70-9fd0-ab923dd82996 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:56.959382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:56.960044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:56.960325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:56.960599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:56.972488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:56.973965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:56.990472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:56.992708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:56.995505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:56.995505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:56.995505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:56.995505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:56.995505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 384/764] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:56.998075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.020626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.021258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.113299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c57aec-1707-46ca-a3e6-4e3dac2f9868 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.148450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.149087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.149371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.150187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.150888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:57.151244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.152632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.165494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 385/765] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:57.170968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.205594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b310f-c291-4c70-9fd0-ab923dd82996 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.260431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c6bf3-c957-4ef0-b4fd-f94d451ddc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.261088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6bf3-c957-4ef0-b4fd-f94d451ddc85 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.261373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6bf3-c957-4ef0-b4fd-f94d451ddc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.261646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6bf3-c957-4ef0-b4fd-f94d451ddc85 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.262271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c6bf3-c957-4ef0-b4fd-f94d451ddc85 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.263922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c6bf3-c957-4ef0-b4fd-f94d451ddc85 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-181c6bf3-c957-4ef0-b4fd-f94d451ddc85 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:57.272855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:57.273778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:57.274700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 381/766] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Jul 31 18:24:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:57.275915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.283994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146331f-e0e0-4e02-b83b-8328af68154c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.284279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146331f-e0e0-4e02-b83b-8328af68154c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.284556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146331f-e0e0-4e02-b83b-8328af68154c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.285910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 382/767] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:57.286616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146331f-e0e0-4e02-b83b-8328af68154c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.324001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982649-84b6-4a89-8af7-9b48d217e3af None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.361929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b79aef-d7bd-4840-9048-a4fd7c857212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.362590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79aef-d7bd-4840-9048-a4fd7c857212 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.362870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79aef-d7bd-4840-9048-a4fd7c857212 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.363176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79aef-d7bd-4840-9048-a4fd7c857212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.371036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b79aef-d7bd-4840-9048-a4fd7c857212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.372823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b79aef-d7bd-4840-9048-a4fd7c857212 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.379770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-10b79aef-d7bd-4840-9048-a4fd7c857212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:24:57.388561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:57.389922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:24:57.390922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:57.393016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 386/768] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:57.394432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c89c7-2180-41d7-bdad-6a9de94f9c8c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.394722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c89c7-2180-41d7-bdad-6a9de94f9c8c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.395018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c89c7-2180-41d7-bdad-6a9de94f9c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.395421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146331f-e0e0-4e02-b83b-8328af68154c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.413715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3d0c89c7-2180-41d7-bdad-6a9de94f9c8c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:57.414985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3d0c89c7-2180-41d7-bdad-6a9de94f9c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:57.434917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.435813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.436287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.436752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.437786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:57.438286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.442769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.449270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 383/769] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:57.450330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.504494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 387/770] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:24:57.505737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c89c7-2180-41d7-bdad-6a9de94f9c8c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.554548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4bf52-9bb8-4f34-a7db-148b0ee7e0a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.585294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.594389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.595397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.595886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.596358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.597416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:57.598021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.599673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.613653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 384/771] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:57.614915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.630497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.636332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c89c7-2180-41d7-bdad-6a9de94f9c8c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.679476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.680107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.680387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.680663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.681873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:57.682230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.684764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.696492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 388/772] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:57.697390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.730385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f4a63-c1de-4a88-a34a-c30ce1a5a558 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.768131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.769157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.769641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.770367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.771794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.773637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:57.786078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:57.787103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:24:57.787950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:57.790998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 385/773] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:57.792180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.817297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc23bdb-b079-42ee-8a4f-2bf9a9cc003c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.837779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.856475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.857145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.857423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.857692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/31e9920dd81b4f0a8a28a4e8ebef2ae2/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.859689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=31e9920dd81b4f0a8a28a4e8ebef2ae2, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.861121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.875098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 389/774] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:24:57 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/31e9920dd81b4f0a8a28a4e8ebef2ae2/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:24:57.880310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:57.895435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:57.911620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b511-fcc7-4e7c-8a5a-06d2e5ae96b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:57.965673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e53de6-9124-4be7-a3a2-d562c55c5838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:57.966668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e53de6-9124-4be7-a3a2-d562c55c5838 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.966968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e53de6-9124-4be7-a3a2-d562c55c5838 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.967568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e53de6-9124-4be7-a3a2-d562c55c5838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.968786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e53de6-9124-4be7-a3a2-d562c55c5838 None admin] RBAC: Adding query filter params (interface=public, service_id=ae180ad5880e4a98aeab3f7bde34850f, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:57.969225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e53de6-9124-4be7-a3a2-d562c55c5838 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:57.971615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e53de6-9124-4be7-a3a2-d562c55c5838 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:57.988234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 386/775] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/endpoints?service_id=ae180ad5880e4a98aeab3f7bde34850f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:57.988234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c844bd2-1b3b-46ad-b755-9e24a4715e9b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:57.988234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c844bd2-1b3b-46ad-b755-9e24a4715e9b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:57.988234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c844bd2-1b3b-46ad-b755-9e24a4715e9b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:57.989931 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 387/776] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:57.990813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c844bd2-1b3b-46ad-b755-9e24a4715e9b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.029608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6bec-59ed-4706-abda-cdaf978eaa9d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.074479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1e8b3-04a5-495e-8264-cd253826d802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.075248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1e8b3-04a5-495e-8264-cd253826d802 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.075593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1e8b3-04a5-495e-8264-cd253826d802 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.075932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1e8b3-04a5-495e-8264-cd253826d802 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.076689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1e8b3-04a5-495e-8264-cd253826d802 None admin] RBAC: Adding query filter params (name=network) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:58.077059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1e8b3-04a5-495e-8264-cd253826d802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:58.078505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1e8b3-04a5-495e-8264-cd253826d802 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:58.083688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 390/777] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:58.085080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaa0c-918b-4a3e-b33b-50e9b74a16cb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.085363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaa0c-918b-4a3e-b33b-50e9b74a16cb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.085638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaa0c-918b-4a3e-b33b-50e9b74a16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.114385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c844bd2-1b3b-46ad-b755-9e24a4715e9b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.118589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-785aaa0c-918b-4a3e-b33b-50e9b74a16cb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:58.119873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-785aaa0c-918b-4a3e-b33b-50e9b74a16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:58.151452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.152004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.152393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.152668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.153438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:58.154813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:58.161583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 388/778] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:24:57 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:58.162538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.162905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:58.168050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:58.211314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 391/779] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:24:58.234257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aaa0c-918b-4a3e-b33b-50e9b74a16cb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.299804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653f28-af7d-4ffd-9a24-8754ee1478a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.344785 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.345417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.345766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.346078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.346911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:58.347391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:58.348946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:58.353603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aaa0c-918b-4a3e-b33b-50e9b74a16cb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.354727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 389/780] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:58.364204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.402596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.403198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.403754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.404031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.425902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:58.432437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:58.433406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:58.435505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 392/781] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:58.439720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.482101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:58.490747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:58.523425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffff0e-c960-4378-84ad-cad54e08ea93 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.561153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.561783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.562068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.562343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.563125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] RBAC: Adding query filter params (interface=public, service_id=22df38d402c54095bf0724fb3d9da321, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:58.563440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:58.564826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:58.570577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 390/782] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/endpoints?service_id=22df38d402c54095bf0724fb3d9da321&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:58.576092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.583256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ee796-9ef4-47d1-a4de-be96291b0a78 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.623620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.624533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.624817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.625095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.626084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:58.626394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:58.627808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:58.638132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 393/783] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:58.644218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.732769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222c4e-6126-44f4-bfb9-aef10f0f8c19 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.772887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:58.776332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:58.780443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f8ecc-1b63-46ac-899f-2eb6bf2ba0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.781534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8ecc-1b63-46ac-899f-2eb6bf2ba0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.782014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8ecc-1b63-46ac-899f-2eb6bf2ba0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.782507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8ecc-1b63-46ac-899f-2eb6bf2ba0b6 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.783435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8ecc-1b63-46ac-899f-2eb6bf2ba0b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:58.785017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8ecc-1b63-46ac-899f-2eb6bf2ba0b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:58.785647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c959a-3960-4575-bc09-70a69939fa7d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:58.792811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 391/784] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:58.794388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a630-7a17-4f26-a920-173fd8548988 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.794955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a630-7a17-4f26-a920-173fd8548988 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.795465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a630-7a17-4f26-a920-173fd8548988 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.801419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 392/785] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:24:58.803618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04454a1-17d6-416d-8025-e02a6cc55db8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.804128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04454a1-17d6-416d-8025-e02a6cc55db8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.804622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04454a1-17d6-416d-8025-e02a6cc55db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.824653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e04454a1-17d6-416d-8025-e02a6cc55db8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:24:58.826392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e04454a1-17d6-416d-8025-e02a6cc55db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:24:58.827421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:58.828089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:58.828369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:58.828643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:58.843074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:58.844590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:58.864860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:58.865855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:58.867234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:58.867234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:58.867234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:58.867234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:58.867234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 394/786] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:58.872844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:58.931509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 393/787] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:24:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:24:58.950572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04454a1-17d6-416d-8025-e02a6cc55db8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.046528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a440-6e8b-494a-a459-7a7590090af8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.080821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04454a1-17d6-416d-8025-e02a6cc55db8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.084844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.085700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.086150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.086574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.088754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:59.089219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:59.091119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:59.105598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 395/788] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:59.111754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.113753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:59.125098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:59.125480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.126639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.127097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.128357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.142406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:24:59.149030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:59.150715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:24:59.151784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:59.156639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 394/789] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:59.158897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.249375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96873a-a4c9-45a2-afb0-ae95415e7fb0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.289997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.290845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.291659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.291942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.300126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:59.301974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:24:59.316850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:59.318956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:59.320222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 396/790] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:59.320970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead35e84-33b4-4a21-b4c2-f1f628524adc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.329914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.407659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.408344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.408686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.408962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.409684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:59.409985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:59.411393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:59.415621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:59.433749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 395/791] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:59.439695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.485307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d7aff-18f7-468f-a2b3-fe8675a3c55a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.524122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.525276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.525782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.526272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.527318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:59.527829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:59.529484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:59.548848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 397/792] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:24:59.554665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.560484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:59.653203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606a4aa-56e8-467d-afce-aca292060f1a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.666209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefb00-fc96-478e-85de-955aa3514646 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.694337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:59.707558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.708512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.709032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.709507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.720622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:59.722427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:59.738771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:59.739923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:59.741040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:59.741040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:59.741040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:59.741040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:24:59.742846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 398/793] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:24:59.748735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.760574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.761387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.761517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.761787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.784907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:59.786381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:24:59.820425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:24:59.821633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:24:59.822769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:24:59.822769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:24:59.822769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:24:59.822769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:24:59.831265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 396/794] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:24:59.832145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.858468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0b49-eef6-4e5a-90db-2db32f67b313 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.895809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:24:59.896932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:24:59.897727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:24:59.898512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:24:59.900270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:24:59.900803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:24:59.902408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:24:59.917704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 399/795] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:24:59.923646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:24:59.960720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:24:59.964304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e46c-640b-4676-bd03-3db67b04e19f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:24:59.977557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:00.035116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bed57e-7cd1-4584-9b89-b9730b3923de None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:00.063651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:00.064448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.064603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.064824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.065520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:00.065830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:00.067235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:00.076769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:00.078529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.079037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.082086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.092178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:00.095756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 397/796] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:00.096350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:00.101523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:00.123809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:00.124793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:00.125714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 400/797] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:00.132724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:00.287314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:00.293222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1a550-b496-4e37-b509-345f58b51b25 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:00.330487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:00.331530 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.332030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.332533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.333487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:00.334002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:00.335686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:00.336875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaef45e-099b-4a65-b8dd-7eab4914c5e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:00.349705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 401/798] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:00.356718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:00.405260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841ed1b-956a-4bbe-a87e-8a30fe83eb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:00.405686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841ed1b-956a-4bbe-a87e-8a30fe83eb32 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.405962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841ed1b-956a-4bbe-a87e-8a30fe83eb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.406233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841ed1b-956a-4bbe-a87e-8a30fe83eb32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.418822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841ed1b-956a-4bbe-a87e-8a30fe83eb32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:00.420349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841ed1b-956a-4bbe-a87e-8a30fe83eb32 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a841ed1b-956a-4bbe-a87e-8a30fe83eb32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:00.434914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:00.435958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:00.436929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 398/799] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:00.437526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3272c3-fdf5-4ae3-8d6c-80afa239677d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.438696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3272c3-fdf5-4ae3-8d6c-80afa239677d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.438696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3272c3-fdf5-4ae3-8d6c-80afa239677d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.439522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 399/800] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:00.444324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3272c3-fdf5-4ae3-8d6c-80afa239677d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:00.471981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:00.479604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ed52-25ce-4d18-a249-c45cf812d6e2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:00.517713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8171728-4528-4013-8926-046731d468f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:00.518588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171728-4528-4013-8926-046731d468f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.518954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171728-4528-4013-8926-046731d468f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.519313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171728-4528-4013-8926-046731d468f4 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/08b3612fd73644c99e1d8aeb8af68411/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.536259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171728-4528-4013-8926-046731d468f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=08b3612fd73644c99e1d8aeb8af68411, role_id=04bcfbb7bd794ed2bc75b6228f5c4ae9)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:00.537925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171728-4528-4013-8926-046731d468f4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:00.553203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 402/801] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:25:00 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/08b3612fd73644c99e1d8aeb8af68411/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:25:00.560644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9b38-1602-447c-a555-7b5f980eecb0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.561057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9b38-1602-447c-a555-7b5f980eecb0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.561610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9b38-1602-447c-a555-7b5f980eecb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.565706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3272c3-fdf5-4ae3-8d6c-80afa239677d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:00.579230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:00.595528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dfcd9b38-1602-447c-a555-7b5f980eecb0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:00.597007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dfcd9b38-1602-447c-a555-7b5f980eecb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:00.618031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:00.620046 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.620576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.622243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.623793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:00.625023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:00.626923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:00.658961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 400/802] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Jul 31 18:25:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:00.668386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:00.731892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 403/803] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:00.739119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b7dec-4d10-4034-a6cf-b5079551ac83 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.739119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b7dec-4d10-4034-a6cf-b5079551ac83 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.739119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b7dec-4d10-4034-a6cf-b5079551ac83 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.739119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 404/804] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:00.740529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f22ad-13f3-49ed-b818-0b4f2c1c3356 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.740808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f22ad-13f3-49ed-b818-0b4f2c1c3356 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.741080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f22ad-13f3-49ed-b818-0b4f2c1c3356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.765224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f28f22ad-13f3-49ed-b818-0b4f2c1c3356 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:00.766474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f28f22ad-13f3-49ed-b818-0b4f2c1c3356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:00.787090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:00.817220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70c752-6dcd-45fb-8c37-a38af192f086 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:00.855321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:00.856296 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:00.856832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:00.857395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:00.858960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 405/805] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:00.859916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f22ad-13f3-49ed-b818-0b4f2c1c3356 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:00.869180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:00.871207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:00.887540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:00.888903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:00.890029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:00.890029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:00.890029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:00.890029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:00.891897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 401/806] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:00.897261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:00.935240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:00.981612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f22ad-13f3-49ed-b818-0b4f2c1c3356 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.019136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fc151-0a6f-474f-951b-272dfcff4e8f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.019932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.020775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.021253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.021701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.032949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:01.038242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:01.039455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:01.040868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:01.049347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 406/807] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:01.051369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.055288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:01.059864 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.060508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.060791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.061110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.061816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:01.062124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.063584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.079635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 402/808] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:01.081128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.176922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff78f5-1465-4925-9582-6051a9fb923a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.204389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac64c-7980-4e2b-94aa-fd0888e380e6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.210905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:01.223939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.224819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.225243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.225655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.226970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.229448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.241467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.242088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.242363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.242634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.243598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:01.243904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:01.244196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:01.245307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 18:25:01.246454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:01.247440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.249741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 407/809] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:01.250672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.256346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 403/810] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:01.256996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.316908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:01.369555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eea63-469a-44fd-a223-5e654bd0b2b4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.389371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb384f-fb5b-47ac-a951-56b3f80b2681 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.418432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.419618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.420317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.420799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.422227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:01.422767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.424335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.425962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5e7f0-7614-44b9-a426-ffec49c2f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.426722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5e7f0-7614-44b9-a426-ffec49c2f521 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.427164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5e7f0-7614-44b9-a426-ffec49c2f521 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.427476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5e7f0-7614-44b9-a426-ffec49c2f521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.431543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 404/811] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:01.433439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.442068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5e7f0-7614-44b9-a426-ffec49c2f521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.442068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5e7f0-7614-44b9-a426-ffec49c2f521 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-95b5e7f0-7614-44b9-a426-ffec49c2f521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:01.451119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:01.452030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:01.452950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 408/812] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:01.454048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785180f-320f-4314-9c38-14ad5445f7a5 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.454048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785180f-320f-4314-9c38-14ad5445f7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.454048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785180f-320f-4314-9c38-14ad5445f7a5 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.459289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 409/813] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:01.459289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785180f-320f-4314-9c38-14ad5445f7a5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.511689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:01.547836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc22ec-ce02-46ea-ab08-5547da4ac5db None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.564368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:01.570721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785180f-320f-4314-9c38-14ad5445f7a5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.582557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.583227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.583507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.583784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.595342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.596792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.608184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd65ba6-b318-4a7f-9047-a859a9e87d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.609015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd65ba6-b318-4a7f-9047-a859a9e87d10 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.609510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd65ba6-b318-4a7f-9047-a859a9e87d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.609968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd65ba6-b318-4a7f-9047-a859a9e87d10 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.610820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd65ba6-b318-4a7f-9047-a859a9e87d10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:01.611332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd65ba6-b318-4a7f-9047-a859a9e87d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:01.611649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:01.612534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:01.613455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:01.613455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:01.613455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:01.613455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:01.613455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 405/814] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:01.613741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.615421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd65ba6-b318-4a7f-9047-a859a9e87d10 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.622269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 410/815] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:01.623555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1037-d095-49e0-af66-548ed4511212 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.623840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1037-d095-49e0-af66-548ed4511212 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.624119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1037-d095-49e0-af66-548ed4511212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.641995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b64a1037-d095-49e0-af66-548ed4511212 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:01.643252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b64a1037-d095-49e0-af66-548ed4511212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:01.716027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 411/816] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:01.717030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1037-d095-49e0-af66-548ed4511212 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.737406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2531c4-940b-42e3-9e8a-ffa44ed1a946 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.764230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:01.778852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.779964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.780457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.780922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.781848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:01.782318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.784017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.798791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 406/817] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:01.799968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.829587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1037-d095-49e0-af66-548ed4511212 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.832128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:01.869873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.870659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.870958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.871237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.871927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:01.872229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.873598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.884836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 412/818] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:01.885627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:01.913953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cef26-4827-44b6-8917-cb43c7aefea2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:01.950667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:01.951311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:01.951609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:01.951866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:01.952561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:01.953920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:01.983049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 407/819] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:01.983049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:02.009469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567eba9-d37c-4222-92a4-31b2f5176ff6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.015254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:02.074862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.075568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.075845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.076117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] PATH_INFO: `/v3/services/network` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.077300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.079360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.090170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:02.092991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:02.094125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 18:25:02.095180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:02.099741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 413/820] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:01 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:02.100676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:02.120858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702173-0a1b-4da2-9be6-f6be0bfcb67f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.175288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.175972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.176245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.176519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/25905fe87291438aa787ecada5cb6865/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.178638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=25905fe87291438aa787ecada5cb6865, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.180368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.198110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 408/821] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:25:01 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/25905fe87291438aa787ecada5cb6865/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:25:02.199880 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:02.236921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1f71e-a4c1-46a8-85fa-d2b4d75e7598 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.292840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.293838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.294132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.294408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.313684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.318085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:02.339681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:02.340717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:02.341678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:02.344461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 414/822] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:25:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:02.352780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:02.397943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d7e62-3f80-49df-83a5-3aaa49706d34 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.400769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:02.439021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.439721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.440496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.440496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.441122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:02.441496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.442966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.453403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 409/823] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:02.454713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:02.467558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:02.498747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d164-38db-4162-bcb6-cb3b08ad760f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.538356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.539372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.539938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.540952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.542099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:02.542691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.544449 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.564394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 415/824] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:25:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:02.571004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6882f4-512b-41ad-8a13-cc62db4ca7b0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.580458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:02.614490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.615155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.615433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.615707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.616385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:02.616689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.618075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.639048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 410/825] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:02.648873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:02.753327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:02.756441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:02.767134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6cb47-c0c4-4b98-95da-a6fc957eb5c7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.794916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f72b9-3339-4931-9b34-d5e7d3251997 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:02.803827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.804704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.805186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.805714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.837386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9d534-ec03-4f96-8d02-ec81875a264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:02.838444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d534-ec03-4f96-8d02-ec81875a264f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.838725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d534-ec03-4f96-8d02-ec81875a264f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.839029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d534-ec03-4f96-8d02-ec81875a264f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.839749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9d534-ec03-4f96-8d02-ec81875a264f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.841307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9d534-ec03-4f96-8d02-ec81875a264f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.870162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 411/826] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:02.872233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453646c-3058-4b4a-a94d-19f5ed402642 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.872529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453646c-3058-4b4a-a94d-19f5ed402642 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.872812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453646c-3058-4b4a-a94d-19f5ed402642 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.874973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 412/827] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:02.880651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368126-7978-403c-a83f-29f97e5dcbfc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:02.881162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368126-7978-403c-a83f-29f97e5dcbfc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:02.882253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368126-7978-403c-a83f-29f97e5dcbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:02.890203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:02.891835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:02.909833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-26368126-7978-403c-a83f-29f97e5dcbfc None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:02.912146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-26368126-7978-403c-a83f-29f97e5dcbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:02.986521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:03.014730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 413/828] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:03.032043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 416/829] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:03.037466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368126-7978-403c-a83f-29f97e5dcbfc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.045584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.143477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:03.199341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368126-7978-403c-a83f-29f97e5dcbfc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.201075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c082e-c698-43f3-aa23-6f18c430c827 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.244603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.245259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.245536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.245807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.246358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.247209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.247634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.248371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.261652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:03.262637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:03.263553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:03.268271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:03.269424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:03.272635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 417/830] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:03.275873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:03.286549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:03.287806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:03.288765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:03.288765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:03.288765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:03.288765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:03.291869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 414/831] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:03.299539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.337980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:03.401087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407813e-fdaf-4392-bcb7-6d8dff0a354c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.412286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3aa7-c273-46ab-961b-2e7b6f5b0fad None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.420530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:03.435798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.436605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.437058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.437477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.438347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:03.438833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:03.440479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:03.449881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 418/832] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:03.455474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.463623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.464327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.464693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.465086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.465983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:03.466302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:03.467769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:03.481814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 415/833] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:03.487524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.560764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c92b5f-0b90-4b27-a4ef-ae0c609fb5f9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.563819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:03.597114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600459-ad38-48c4-b2f0-1552b1922a42 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.598088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.599242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.600595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.601079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.614972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:03.617569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:03.637129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.637967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.638311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.638958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:03.640396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:03.641288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:03.642189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:03.642189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:03.642189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:03.642189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:03.644799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 419/834] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:03.651472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.652553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:03.654018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:03.670209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:03.671200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:03.672113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 416/835] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:03.680128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.715477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:03.769749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd3ae-e3e3-4c6e-b657-e5a76e094917 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.804002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254bda-36fc-4947-801e-faa58cb9ef0d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.807080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.807935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.808464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.808947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.809827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:03.810335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:03.812040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:03.829302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 420/836] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:03.830459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.844525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.845534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.846010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.846659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:03.848070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:03.848835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:03.850151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:03.852076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:03.876328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 417/837] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:03.876915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:03.955171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ff3b-ff22-4945-b057-d10788b454e6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.983719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053c4c-945c-456c-988e-36049aa54bd5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:03.992855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:03.994137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:03.994421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:03.994697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.002769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:04.004259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:04.017496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:04.018457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:04.019438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:04.023217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 421/838] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:04.023489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:04.025202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.031742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:04.032667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.033147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.033618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.034599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:04.035158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:04.037334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:04.047368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 418/839] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:03 2022] GET /identity/v3/role_assignments?user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:04.122476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:04.149782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c088ac6-dd17-4325-bd46-69a66dd0b82b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:04.188026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd77c8-ff77-4875-8053-02d2d0eae7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:04.189056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd77c8-ff77-4875-8053-02d2d0eae7ae None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.189614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd77c8-ff77-4875-8053-02d2d0eae7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.190086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd77c8-ff77-4875-8053-02d2d0eae7ae None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.191129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd77c8-ff77-4875-8053-02d2d0eae7ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:04.191638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd77c8-ff77-4875-8053-02d2d0eae7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:04.193406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd77c8-ff77-4875-8053-02d2d0eae7ae None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:04.213163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 422/840] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:04.219106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.237112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee61b41-0649-4c44-b0ae-286195d74f11 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.237112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee61b41-0649-4c44-b0ae-286195d74f11 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.237396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee61b41-0649-4c44-b0ae-286195d74f11 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.238955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 423/841] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:04.244521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8217-d9e5-4513-9f72-8ac88eaea8cf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.244843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8217-d9e5-4513-9f72-8ac88eaea8cf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.245109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8217-d9e5-4513-9f72-8ac88eaea8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.264777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bcbc8217-d9e5-4513-9f72-8ac88eaea8cf None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:04.265986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bcbc8217-d9e5-4513-9f72-8ac88eaea8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:04.354879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d245c-4f86-49df-b800-77847c0eaa7e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:04.360020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 424/842] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:04.382621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc8217-d9e5-4513-9f72-8ac88eaea8cf None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.393338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909ccd6-1a12-4c7c-94bd-61d9fd3ae604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:04.394142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ccd6-1a12-4c7c-94bd-61d9fd3ae604 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.394488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ccd6-1a12-4c7c-94bd-61d9fd3ae604 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.394821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ccd6-1a12-4c7c-94bd-61d9fd3ae604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.421050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:04.467748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:04.493591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909ccd6-1a12-4c7c-94bd-61d9fd3ae604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:04.495206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909ccd6-1a12-4c7c-94bd-61d9fd3ae604 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:04.516611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc8217-d9e5-4513-9f72-8ac88eaea8cf None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:04.554337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbae067-36a4-4e3a-8c3d-8f93a2b38b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:04.555142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbae067-36a4-4e3a-8c3d-8f93a2b38b31 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.555419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbae067-36a4-4e3a-8c3d-8f93a2b38b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.556389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbae067-36a4-4e3a-8c3d-8f93a2b38b31 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.556848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbae067-36a4-4e3a-8c3d-8f93a2b38b31 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:04.558218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbae067-36a4-4e3a-8c3d-8f93a2b38b31 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ccbae067-36a4-4e3a-8c3d-8f93a2b38b31 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:04.567212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:04.568184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:04.569034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 425/843] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:04.576340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c936d-8124-4a3d-817e-e2b8bfbce476 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.576340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c936d-8124-4a3d-817e-e2b8bfbce476 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.576340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c936d-8124-4a3d-817e-e2b8bfbce476 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.576340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 426/844] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:04.576340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c936d-8124-4a3d-817e-e2b8bfbce476 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.619402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 419/845] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:04.619402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1066e2-af25-4d01-9d08-2b11275fbbc2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.619402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1066e2-af25-4d01-9d08-2b11275fbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.619402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1066e2-af25-4d01-9d08-2b11275fbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.639242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4e1066e2-af25-4d01-9d08-2b11275fbbc2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:04.640345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e1066e2-af25-4d01-9d08-2b11275fbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:04.683783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c936d-8124-4a3d-817e-e2b8bfbce476 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:04.689786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:04.709932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:04.718990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 420/846] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:04.718990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1066e2-af25-4d01-9d08-2b11275fbbc2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.728123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:04.728714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.728995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.729269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.730423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:04.730738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:04.732408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:04.738999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 427/847] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:04.739729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.830663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1066e2-af25-4d01-9d08-2b11275fbbc2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:04.841174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59af5-6f73-4c98-8082-777d208820cb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:04.867399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:04.868608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.868867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.869140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.875196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:04.875841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:04.876117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:04.876389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:04.880568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:04.882430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:04.889363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:04.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:04.895583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:04.896432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 428/848] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:04.897586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:04.906067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:04.907172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:04.908306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:04.908306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:04.908306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:04.908306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:04.914270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 421/849] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:04.915871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:04.950082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:04.957715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:05.009457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea32e6-3bcb-45c9-9dec-e01cb26f64ea None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.025615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326d2fd-db58-4d48-8093-7954cb6152b5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.045346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.046066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.046417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.046770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.047609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:05.047986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.049433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.054398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 429/850] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:05.055495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.069945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.071138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.071673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.072133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.073066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:05.073569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.075335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.094976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 422/851] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:25:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:05.100346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.187181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d77af-b513-4060-9ff6-9bf1253755bd None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.206111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:05.208317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:05.213937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220cf2-03f4-45a5-a35a-e6c8277a5af0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.230608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.231601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.232108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.232547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.233246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:05.233557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.235050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.248935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 430/852] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:05.255436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.261826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.262605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.263027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.263381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.275380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.276953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:05.293733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:05.294705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:05.296236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:05.296236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:05.296236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:05.296236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:05.296908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 423/853] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:05.301085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.391393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31058374-d0da-4cba-8533-59f461c7d4d8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.424635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72da1-c1da-4da9-9ae9-53fb9c9f4609 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.429232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.430006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.431098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.431482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.439610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.441131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:05.453238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:05.454401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:05.455604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:05.461967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 431/854] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:05.463544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.473911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.474837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.475352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.475844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.476742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:05.477903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.479518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.497166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 424/855] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:05.498825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.502529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:05.510851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:05.593080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa11dd5-f235-4ffe-8a4f-5739f204b6a7 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.622183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf4d0-3617-46a9-bb9b-c03273984eca None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.637268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.637894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.638414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.638969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.639731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:05.640500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.642240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.661037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 432/856] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:05.667180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.670596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.671971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.671971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.672211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.680337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.682078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:05.695253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:05.697027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 18:25:05.698219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:05.704689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 425/857] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:05.706145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:05.780025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:05.791825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:05.802349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0d821-8c9d-4725-8282-34fe2b06f1d0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.828008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96701-810b-4288-b41c-0e356b69fa73 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:05.847318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.848867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.849535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.849953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.851069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=08b3612fd73644c99e1d8aeb8af68411) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:05.851545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.854040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.862125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 433/858] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/role_assignments?user.id=08b3612fd73644c99e1d8aeb8af68411&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:05.876980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dac9c-6bde-4344-8711-95249658c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:05.877921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dac9c-6bde-4344-8711-95249658c343 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:05.878349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dac9c-6bde-4344-8711-95249658c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:05.878764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dac9c-6bde-4344-8711-95249658c343 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:05.879769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dac9c-6bde-4344-8711-95249658c343 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:05.880228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dac9c-6bde-4344-8711-95249658c343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:05.881880 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dac9c-6bde-4344-8711-95249658c343 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:05.904780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 426/859] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:05.910470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.022885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7924f-e862-4257-b36b-cfb7517972cc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:06.062099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:06.062730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.063181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.063287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.094483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:06.139415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:06.140883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:06.188086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26a07d-3f82-4e5c-8f03-4b76997f46d2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.188403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26a07d-3f82-4e5c-8f03-4b76997f46d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.188644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26a07d-3f82-4e5c-8f03-4b76997f46d2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.190229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 427/860] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:06.195474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8522c-de48-4658-8935-c8fb94c27593 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.195755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8522c-de48-4658-8935-c8fb94c27593 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.196025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8522c-de48-4658-8935-c8fb94c27593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.216137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3ff8522c-de48-4658-8935-c8fb94c27593 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:06.217377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3ff8522c-de48-4658-8935-c8fb94c27593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:06.266448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 434/861] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 18:25:06.268016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.297065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 428/862] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:06.320516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8522c-de48-4658-8935-c8fb94c27593 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.340076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:06.383107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:06.395348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e945-fc85-4f16-9562-8795f9c98cdb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:06.439789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8522c-de48-4658-8935-c8fb94c27593 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:06.452560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:06.453907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.454657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.455178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.470329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:06.472722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:06.479257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:06.479921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.480205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.480480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.481110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:06.482509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:06.491436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:06.492355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:06.493322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:06.493322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:06.493322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:06.493322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:06.493962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:06.494844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:06.495739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:06.497562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 435/863] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:06.498737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.499930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 429/864] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Jul 31 18:25:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:06.500570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.613007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e68a2-f664-41ee-879f-b3020636a1e2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:06.632498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:06.634223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a842963-7d83-4783-810c-3deb47beab72 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:06.653133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:06.654297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:06.655030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.655404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.655680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.656459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:06.656723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:06.658105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:06.669136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 430/865] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:06.670131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.678853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:06.680253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.681354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.681955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.683270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:06.684122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:06.685915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:06.703273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 436/866] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:06.708974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.795125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42b16-9e4a-4ba1-aa1d-3f85657e1f4b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:06.841552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:06.842177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.842457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.842729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.843429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:06.843733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:06.844807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3231a0-ad79-4e06-97c5-a4a6f39eb80f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:06.845101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:06.850605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 431/867] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:06.889591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:06.891023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:06.891547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:06.892028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:06.901036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:06.902897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:06.916534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:06.917516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:06.918419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:06.921070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 437/868] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:06.927373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:06.981952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:07.041183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe354-c928-4e8c-8d28-42d7e06d4c1e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:07.079982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daf7d5-2c07-4814-9096-e01774e730a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:07.080959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf7d5-2c07-4814-9096-e01774e730a2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:07.081450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf7d5-2c07-4814-9096-e01774e730a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:07.081970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf7d5-2c07-4814-9096-e01774e730a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:07.083033 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daf7d5-2c07-4814-9096-e01774e730a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:07.083564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daf7d5-2c07-4814-9096-e01774e730a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:07.085201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daf7d5-2c07-4814-9096-e01774e730a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:07.103631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 432/869] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:07.106622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:07.141657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:07.186281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17414d40-8818-45c5-9b0d-89f3603cd7d7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:07.186601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17414d40-8818-45c5-9b0d-89f3603cd7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:07.186839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17414d40-8818-45c5-9b0d-89f3603cd7d7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:07.188370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 433/870] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:07.193944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215fc4-810d-40e5-9f40-59648d0ba87e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:07.194524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215fc4-810d-40e5-9f40-59648d0ba87e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:07.195030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215fc4-810d-40e5-9f40-59648d0ba87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:07.213528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-21215fc4-810d-40e5-9f40-59648d0ba87e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:07.215102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-21215fc4-810d-40e5-9f40-59648d0ba87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:07.229164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697d3f0-b8ef-4c95-9584-2ce9f5fab4b1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:07.270124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:07.271120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:07.271599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:07.272098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:07.273086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=25905fe87291438aa787ecada5cb6865) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:07.273603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:07.275358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:07.282031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 438/871] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:07 2022] GET /identity/v3/role_assignments?user.id=25905fe87291438aa787ecada5cb6865&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:07.303085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 434/872] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:07.322738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:07.430340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:07.438315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2807be-0856-43cc-a503-52b3292258f8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:07.480534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fed7c-6330-4f31-939f-b15663a69fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:07.481161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fed7c-6330-4f31-939f-b15663a69fa8 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:07.481436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fed7c-6330-4f31-939f-b15663a69fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:07.481704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fed7c-6330-4f31-939f-b15663a69fa8 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:07.482406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fed7c-6330-4f31-939f-b15663a69fa8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:07.483883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fed7c-6330-4f31-939f-b15663a69fa8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:07.501259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 439/873] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:25:07 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:08.063490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb2158-8946-4345-a420-614b812a3465 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.064126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb2158-8946-4345-a420-614b812a3465 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.064126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb2158-8946-4345-a420-614b812a3465 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.065658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 435/874] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:08.070762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499a5d-749a-428b-b3ed-785d03071bca None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.071259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499a5d-749a-428b-b3ed-785d03071bca None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.071482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499a5d-749a-428b-b3ed-785d03071bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.090501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-28499a5d-749a-428b-b3ed-785d03071bca None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:08.091734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-28499a5d-749a-428b-b3ed-785d03071bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:08.170076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 440/875] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:08.193151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb2158-8946-4345-a420-614b812a3465 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:08.230283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:08.299553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb2158-8946-4345-a420-614b812a3465 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:08.334989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:08.335569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.335852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.336129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.347533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:08.352473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:08.353553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:08.354422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 436/876] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Jul 31 18:25:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:08.359918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499a5d-749a-428b-b3ed-785d03071bca None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:08.455247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:08.473214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499a5d-749a-428b-b3ed-785d03071bca None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:08.511723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:08.512703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.513208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.513950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.514855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:08.515380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:08.516949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:08.526017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 441/877] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Jul 31 18:25:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:08.531290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:08.630462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:08.636758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1b45-a68c-4317-999a-ce753a011b88 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:08.672582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:08.673232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.673523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.673795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.684324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:08.685858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:08.701500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:08.702442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:08.703984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:08.703984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:08.703984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:08.703984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:08.707095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 437/878] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:08.708855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:08.815421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b0960-5b63-4bec-87c4-c944797c230b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:08.850368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ad0ce-873b-4ee7-b2d8-9a0e9d73cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:08.851378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad0ce-873b-4ee7-b2d8-9a0e9d73cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.851856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad0ce-873b-4ee7-b2d8-9a0e9d73cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.852420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad0ce-873b-4ee7-b2d8-9a0e9d73cdc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.853321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ad0ce-873b-4ee7-b2d8-9a0e9d73cdc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:08.853822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ad0ce-873b-4ee7-b2d8-9a0e9d73cdc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:08.855411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ad0ce-873b-4ee7-b2d8-9a0e9d73cdc7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:08.868579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 442/879] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:08.877362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:08.925568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2998675-db72-4432-aa12-57ccf5e9d6eb None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.925849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2998675-db72-4432-aa12-57ccf5e9d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.926051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2998675-db72-4432-aa12-57ccf5e9d6eb None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.928328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 443/880] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:08.932872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e2e65-9511-42f3-8724-07c30c5d272d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:08.933146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e2e65-9511-42f3-8724-07c30c5d272d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:08.933414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e2e65-9511-42f3-8724-07c30c5d272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:08.951294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:08.954439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-da9e2e65-9511-42f3-8724-07c30c5d272d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:08.956568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-da9e2e65-9511-42f3-8724-07c30c5d272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:08.993829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3d37c-9bb3-4464-9cb6-0f43c0b85d2d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:09.032350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:09.032905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 444/881] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:09.033028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.033261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.033535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.046159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:09.047902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:09.057160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e2e65-9511-42f3-8724-07c30c5d272d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:09.064720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:09.065997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:09.067788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:09.071126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 438/882] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:25:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:09.075111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:09.091173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:09.205054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e2e65-9511-42f3-8724-07c30c5d272d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:09.215212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ceab7-45df-4dd4-99db-27a227d4c62c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:09.246046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f94fa-0a19-40bf-ae94-63d6dfa247cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:09.247327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f94fa-0a19-40bf-ae94-63d6dfa247cb None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.247818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f94fa-0a19-40bf-ae94-63d6dfa247cb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.248314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f94fa-0a19-40bf-ae94-63d6dfa247cb None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.249226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f94fa-0a19-40bf-ae94-63d6dfa247cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:09.250822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f94fa-0a19-40bf-ae94-63d6dfa247cb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:09.251741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:09.252370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.252649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.252929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.253730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:09.254037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:09.255503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:09.256301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:09.282143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 439/883] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Jul 31 18:25:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:09.283113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:09.288955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 445/884] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:25:09 2022] POST /identity/v3/services => generated 269 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:25:09.362021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:09.404663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15f09b-16e7-4bdb-9e71-7cefc35bc169 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:09.441874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73501b5-e429-4a9a-ae49-3e4237a6ffce None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.442067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73501b5-e429-4a9a-ae49-3e4237a6ffce None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.442289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73501b5-e429-4a9a-ae49-3e4237a6ffce None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.448193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 446/885] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:09.449342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7c3a-e7e4-4635-a484-fafc2ba7794b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.449624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7c3a-e7e4-4635-a484-fafc2ba7794b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.449897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7c3a-e7e4-4635-a484-fafc2ba7794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.452517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:09.453142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.453423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.453703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.469763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c39b7c3a-e7e4-4635-a484-fafc2ba7794b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:09.471348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c39b7c3a-e7e4-4635-a484-fafc2ba7794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:09.532425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:09.533929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:09.562652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 447/886] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:09.584531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7c3a-e7e4-4635-a484-fafc2ba7794b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:09.606636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:09.654894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 440/887] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:09.660268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:09.711131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7c3a-e7e4-4635-a484-fafc2ba7794b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:09.737274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:09.751858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cc54f-2a66-4d4d-b25a-bc3ca3fd57ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:09.752765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc54f-2a66-4d4d-b25a-bc3ca3fd57ad None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.753047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc54f-2a66-4d4d-b25a-bc3ca3fd57ad None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.753318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc54f-2a66-4d4d-b25a-bc3ca3fd57ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.754100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cc54f-2a66-4d4d-b25a-bc3ca3fd57ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:09.755806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cc54f-2a66-4d4d-b25a-bc3ca3fd57ad None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3e3cc54f-2a66-4d4d-b25a-bc3ca3fd57ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:09.767850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:09.768862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:09.776133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 448/888] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:09.776951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd3119-89c0-4e19-943b-a4581028a499 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:09.777030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e76e-8fa9-44f6-a410-fd4430b23a1f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.777030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e76e-8fa9-44f6-a410-fd4430b23a1f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.777030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e76e-8fa9-44f6-a410-fd4430b23a1f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.778521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 449/889] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:09.780331 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009e76e-8fa9-44f6-a410-fd4430b23a1f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:09.806534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4c6a7-465c-4baf-a1b2-c0e60e1d3b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:09.807310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4c6a7-465c-4baf-a1b2-c0e60e1d3b5f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.807681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4c6a7-465c-4baf-a1b2-c0e60e1d3b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.807963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4c6a7-465c-4baf-a1b2-c0e60e1d3b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.818452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4c6a7-465c-4baf-a1b2-c0e60e1d3b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:09.819930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4c6a7-465c-4baf-a1b2-c0e60e1d3b5f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d9f4c6a7-465c-4baf-a1b2-c0e60e1d3b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:09.835699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:09.837189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:09.838623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:09.838623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:09.838623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:09.838623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:09.838623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 441/890] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:09.838623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a275-77f9-4dea-999b-93abb4383df4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.839001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a275-77f9-4dea-999b-93abb4383df4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.839364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a275-77f9-4dea-999b-93abb4383df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.857726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7440a275-77f9-4dea-999b-93abb4383df4 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:09.858908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7440a275-77f9-4dea-999b-93abb4383df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:09.869690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:09.901150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009e76e-8fa9-44f6-a410-fd4430b23a1f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:09.934973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 442/891] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:09.934973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a275-77f9-4dea-999b-93abb4383df4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:09.950239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:09.951019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:09.951367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:09.951960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:09.952701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:09.953076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:09.954701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:09.960020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 450/892] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:09.962232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.018716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:10.050241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a275-77f9-4dea-999b-93abb4383df4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.066341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16103-ff2f-4720-b52f-3f5cf6a1b69e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.088748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.090034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.090462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.090733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.091444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:10.091855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.093336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.099952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.100598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.100877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.101150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.101772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.103776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.110870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 443/893] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:10.110870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.112446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:10.119398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:10.120410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:10.121246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:10.125475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 451/894] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:10.126296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.216542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aaebd-ac94-46a5-bc8f-c73bf9fda872 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.235340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78621ccc-986a-4c49-ad90-ded0bf69fb35 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.249988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.250673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.250965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.251243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.251906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:10.252234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.253602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.253713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:10.263174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 444/895] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:10.263174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.287248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.287999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.288693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.288971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.300879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.302366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:10.320118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:10.321282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:10.322390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:10.326857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 452/896] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:10.327889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.379322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:10.394277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356e90-00fd-4b93-95b9-d49bfb8c2b06 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.450706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.451389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.452147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.452440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.453415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:10.453724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.455932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.457959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6b03b-2c05-46b7-bebd-37c403a735a5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.464526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 445/897] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:10.473633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.511150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.511788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.512091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.512344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.513084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:10.513395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.515753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.531684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 453/898] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:10.537096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.589979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:10.602394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc11a-a3a7-4727-8277-03923f34af50 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.643514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:10.655602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.656231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.656518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.657349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.658026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:10.658330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.660339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.672206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 446/899] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:10.672362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ba92-35ff-4e64-a2a5-e7a22cd94517 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.673183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.717342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.717968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.718248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.718521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.719845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] RBAC: Adding query filter params (role.id=34985ab104fa493390d2eaf8eb613c4a, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=08b3612fd73644c99e1d8aeb8af68411) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:10.720196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.721583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.731024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 454/900] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/role_assignments?user.id=08b3612fd73644c99e1d8aeb8af68411&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=34985ab104fa493390d2eaf8eb613c4a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:10.802044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389382a-8bed-4b64-ae24-307bac651711 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:10.843553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f30c97-7200-4026-8a3d-71933cdf1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:10.844539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f30c97-7200-4026-8a3d-71933cdf1639 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:10.845024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f30c97-7200-4026-8a3d-71933cdf1639 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:10.845500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f30c97-7200-4026-8a3d-71933cdf1639 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:10.846530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f30c97-7200-4026-8a3d-71933cdf1639 None admin] RBAC: Adding query filter params (interface=public, service_id=3ed972aa9c5f44f080e8e5b1ec1b3153, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:10.847167 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f30c97-7200-4026-8a3d-71933cdf1639 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:10.848911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f30c97-7200-4026-8a3d-71933cdf1639 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:10.856891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 447/901] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/endpoints?service_id=3ed972aa9c5f44f080e8e5b1ec1b3153&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:10.862789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:10.982214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:10.985887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df698-e1ea-4080-8a34-8b781f51f457 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:11.025010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16a7ce-6127-4c8f-9204-f226a978a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:11.026027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16a7ce-6127-4c8f-9204-f226a978a16c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:11.026517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16a7ce-6127-4c8f-9204-f226a978a16c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:11.027075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16a7ce-6127-4c8f-9204-f226a978a16c None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:11.027943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16a7ce-6127-4c8f-9204-f226a978a16c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:11.029504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16a7ce-6127-4c8f-9204-f226a978a16c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:11.036211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 455/902] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:25:10 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:25:11.417123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436edef-b456-4590-8ff3-857e019f617d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:11.417642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436edef-b456-4590-8ff3-857e019f617d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:11.417642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436edef-b456-4590-8ff3-857e019f617d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:11.419276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 448/903] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:11.429111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276ee2-84dc-4cb0-8b55-0ebb7647210e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:11.429111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276ee2-84dc-4cb0-8b55-0ebb7647210e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:11.429111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276ee2-84dc-4cb0-8b55-0ebb7647210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:11.453652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f0276ee2-84dc-4cb0-8b55-0ebb7647210e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:11.454846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f0276ee2-84dc-4cb0-8b55-0ebb7647210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:11.531646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 456/904] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:11.554788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436edef-b456-4590-8ff3-857e019f617d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:11.620534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:11.666882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436edef-b456-4590-8ff3-857e019f617d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:11.702738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:11.703765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:11.703765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:11.703940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:11.704489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:11.705866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:11.716592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:11.717584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:11.719194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 449/905] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Jul 31 18:25:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:11.723907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0276ee2-84dc-4cb0-8b55-0ebb7647210e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:11.825467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:11.832475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0276ee2-84dc-4cb0-8b55-0ebb7647210e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:11.870401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:11.871055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:11.871336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:11.871610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:11.872286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:11.872589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:11.874019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:11.879164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 457/906] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:11.885667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:11.997778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac22ac-427e-4489-a5c7-0b0c267fb9eb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:12.022575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:12.035050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:12.035727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.036012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.036288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.036959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:12.037264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:12.038642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:12.044814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 450/907] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:12.050565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:12.157024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270330d-17af-46ba-9cc9-e163dc7d3d46 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:12.192554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d6311-d607-4f44-aea4-bf3a330ba38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:12.193181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d6311-d607-4f44-aea4-bf3a330ba38a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.193454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d6311-d607-4f44-aea4-bf3a330ba38a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.193725 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d6311-d607-4f44-aea4-bf3a330ba38a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.194470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d6311-d607-4f44-aea4-bf3a330ba38a None admin] RBAC: Adding query filter params (interface=public, service_id=c9212d604fb44334aa9859d7966ea6ba, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:12.194773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d6311-d607-4f44-aea4-bf3a330ba38a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:12.196985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d6311-d607-4f44-aea4-bf3a330ba38a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:12.204929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 458/908] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:25:12 2022] GET /identity/v3/endpoints?service_id=c9212d604fb44334aa9859d7966ea6ba&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:12.210499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:12.310968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496197a-d9e2-42a8-9dde-841d969de9d4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.311303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496197a-d9e2-42a8-9dde-841d969de9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.311897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496197a-d9e2-42a8-9dde-841d969de9d4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.313802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 459/909] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:12.318609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23995670-d5ff-4925-a481-ce574feed305 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:12.319592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e124a-ed52-468f-a6fa-8aab5c265f74 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.320160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e124a-ed52-468f-a6fa-8aab5c265f74 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.320724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e124a-ed52-468f-a6fa-8aab5c265f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.339613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-140e124a-ed52-468f-a6fa-8aab5c265f74 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:12.341126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-140e124a-ed52-468f-a6fa-8aab5c265f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:12.359371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:12.359903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:12.360530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.360809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.361079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.361727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:12.363181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:12.371639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 451/910] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:25:12 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:25:12.420196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 460/911] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:12.444263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:12.506021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:12.561673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58426447-732c-4d69-b3f8-c72cf0d1b87c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:12.596721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b4be-3670-4846-9cce-4aef036d8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:12.597346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b4be-3670-4846-9cce-4aef036d8cea None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.597624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b4be-3670-4846-9cce-4aef036d8cea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.597896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b4be-3670-4846-9cce-4aef036d8cea None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.598595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b4be-3670-4846-9cce-4aef036d8cea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:12.600001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b4be-3670-4846-9cce-4aef036d8cea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:12.616244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 452/912] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:25:12 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:12.831715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f79b75-aa24-431f-8e66-eae5ee3095d1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.832240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f79b75-aa24-431f-8e66-eae5ee3095d1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.832240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f79b75-aa24-431f-8e66-eae5ee3095d1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.833831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 461/913] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:12.839985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410441-dfe8-415e-ae1e-e966ee31a274 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:12.840279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410441-dfe8-415e-ae1e-e966ee31a274 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:12.840558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410441-dfe8-415e-ae1e-e966ee31a274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:12.858810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3e410441-dfe8-415e-ae1e-e966ee31a274 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:12.860061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3e410441-dfe8-415e-ae1e-e966ee31a274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:12.939064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 453/914] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:12.968365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f79b75-aa24-431f-8e66-eae5ee3095d1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.078892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f79b75-aa24-431f-8e66-eae5ee3095d1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.116703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157f4c-187c-4671-bf55-4472a98afb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.117771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157f4c-187c-4671-bf55-4472a98afb67 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.118313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157f4c-187c-4671-bf55-4472a98afb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.118793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157f4c-187c-4671-bf55-4472a98afb67 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.129971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157f4c-187c-4671-bf55-4472a98afb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-52157f4c-187c-4671-bf55-4472a98afb67 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:13.136013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:13.137029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:13.137912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:13.140957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 462/915] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Jul 31 18:25:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:13.148319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410441-dfe8-415e-ae1e-e966ee31a274 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.162766 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784038c-67df-4f10-be05-9e0e249f457a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.163453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784038c-67df-4f10-be05-9e0e249f457a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.164019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784038c-67df-4f10-be05-9e0e249f457a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.166436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 463/916] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:13.172046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d57c8-ca08-4630-af6b-0243b298abbd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.172340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d57c8-ca08-4630-af6b-0243b298abbd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.172612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d57c8-ca08-4630-af6b-0243b298abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.192750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:13.193953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1f0d57c8-ca08-4630-af6b-0243b298abbd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:13.195205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1f0d57c8-ca08-4630-af6b-0243b298abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:13.203604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:13.271333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410441-dfe8-415e-ae1e-e966ee31a274 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.286512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 464/917] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:13.309193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d57c8-ca08-4630-af6b-0243b298abbd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.314605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.315264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.315548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.315822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.316542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:13.316849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:13.318301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:13.329566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 454/918] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:13.335262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.440253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d57c8-ca08-4630-af6b-0243b298abbd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.455579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:13.459888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f2c2-7b92-4f65-9d51-0300d3fce747 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.487225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.487902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.488454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.488735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.489378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:13.491499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:13.498530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.499526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.500012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.500486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:13.502066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:13.503106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:13.504249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 465/919] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:13.509764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.520930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:13.522368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:13.525516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:13.543561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:13.544485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:13.545400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:13.545400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:13.545400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:13.545400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:13.552085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 455/920] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:13.553680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.625751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d1ad4-8a6a-4abf-8d95-2d7dd07dfd4d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.662903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.663692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.663973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.664239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.665252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:13.665365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:13.666717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:13.668683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64b974-644b-4635-b8ad-cb6dad48a468 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.676918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 466/921] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:13.677397 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.706586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.707684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.708295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.708871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.709758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:13.710263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:13.712135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:13.729927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 456/922] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:13.731611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.747122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:13.754670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:13.795685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f934b5-2bb2-4edb-9d9c-dc8cb9bb56a8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.843847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.844507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.844781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.845024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.845966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:13.846273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:13.847674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:13.848154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d135e-cdc9-4565-ac8d-359ee3118a8b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:13.853840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 467/923] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:13.860076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.889199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:13.889940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:13.890304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:13.890647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:13.898369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:13.900172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:13.924177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:13.925173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:13.926137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 457/924] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:13.933686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:13.996369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1493a-caa6-4988-b841-e3d72c1708a2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:14.007302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:14.038040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:14.039083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.039578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.039688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89b00-614d-42f1-9ba1-90e9c07d9b39 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:14.040160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.041192 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:14.043044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:14.048468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:14.073531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 468/925] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:25:14.091844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76327e66-ec18-4166-8465-208e89280518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:14.092700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76327e66-ec18-4166-8465-208e89280518 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.092985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76327e66-ec18-4166-8465-208e89280518 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.093260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76327e66-ec18-4166-8465-208e89280518 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.094088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76327e66-ec18-4166-8465-208e89280518 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:14.094447 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76327e66-ec18-4166-8465-208e89280518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:14.096166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76327e66-ec18-4166-8465-208e89280518 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:14.123229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 458/926] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Jul 31 18:25:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:14.124728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:14.243929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d1b8a-492a-45b0-ac4f-d4b58b7e0a4e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:14.280503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:14.281156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.281435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.281709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.295632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:14.297077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:14.312463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:14.313419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:14.314320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:14.314320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:14.314320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:14.314320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:14.314320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 469/927] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:14.319562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76327e66-ec18-4166-8465-208e89280518 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:14.422375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76327e66-ec18-4166-8465-208e89280518 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:14.461781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:14.471217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e935e-b883-4aca-9acd-7c4df390f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:14.472151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e935e-b883-4aca-9acd-7c4df390f369 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.472615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e935e-b883-4aca-9acd-7c4df390f369 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.473085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e935e-b883-4aca-9acd-7c4df390f369 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.473948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e935e-b883-4aca-9acd-7c4df390f369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:14.474426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e935e-b883-4aca-9acd-7c4df390f369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:14.476049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e935e-b883-4aca-9acd-7c4df390f369 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:14.489576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 459/928] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:14.495967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:14.526810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3b72-ea1c-4765-969f-28b956580603 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.527148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3b72-ea1c-4765-969f-28b956580603 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.527396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3b72-ea1c-4765-969f-28b956580603 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.529072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 460/929] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:14.535223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0f5c-7212-468e-8364-045df4400294 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.535812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0f5c-7212-468e-8364-045df4400294 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.536308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0f5c-7212-468e-8364-045df4400294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.560119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dcac0f5c-7212-468e-8364-045df4400294 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:14.561664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dcac0f5c-7212-468e-8364-045df4400294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:14.591842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:14.641516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 461/930] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:14.668835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0f5c-7212-468e-8364-045df4400294 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:14.675039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec705e93-3ae2-427f-91ac-0cd9570c0210 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:14.719575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:14.720575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.721079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.721543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.732192 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:14.734448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:14.749191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:14.750301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:14.751300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:14.754479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 470/931] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:14.761558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:14.809368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0f5c-7212-468e-8364-045df4400294 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:14.828707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:14.853892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bcb39-fd45-422c-b7c2-f3b0c2412b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:14.854551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcb39-fd45-422c-b7c2-f3b0c2412b7f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.855117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcb39-fd45-422c-b7c2-f3b0c2412b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.855397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcb39-fd45-422c-b7c2-f3b0c2412b7f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.856024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcb39-fd45-422c-b7c2-f3b0c2412b7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:14.857542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcb39-fd45-422c-b7c2-f3b0c2412b7f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d27bcb39-fd45-422c-b7c2-f3b0c2412b7f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:14.870533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:14.871712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:14.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 462/932] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Jul 31 18:25:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:14.878761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08eb89-93c6-4d7b-a0f8-17a357ce83a5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.878761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08eb89-93c6-4d7b-a0f8-17a357ce83a5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.878761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08eb89-93c6-4d7b-a0f8-17a357ce83a5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.879489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 463/933] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:14.880268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08eb89-93c6-4d7b-a0f8-17a357ce83a5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:14.901134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866511-0d27-41c1-8458-4834045e1e2e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:14.903318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:14.949735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ee9b7-a385-4227-aaa7-636e43f05dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:14.950543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee9b7-a385-4227-aaa7-636e43f05dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.950826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee9b7-a385-4227-aaa7-636e43f05dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.951151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee9b7-a385-4227-aaa7-636e43f05dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.952217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ee9b7-a385-4227-aaa7-636e43f05dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:14.952524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ee9b7-a385-4227-aaa7-636e43f05dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:14.953961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ee9b7-a385-4227-aaa7-636e43f05dc7 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:14.975599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 471/934] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:14.975599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354e78-598a-4b07-9100-53a3e7d04d38 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:14.975599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354e78-598a-4b07-9100-53a3e7d04d38 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:14.975599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354e78-598a-4b07-9100-53a3e7d04d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:14.994418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ac354e78-598a-4b07-9100-53a3e7d04d38 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:14.995750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ac354e78-598a-4b07-9100-53a3e7d04d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:15.015114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08eb89-93c6-4d7b-a0f8-17a357ce83a5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.057280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.058015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.058357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.058700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.059524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:15.059842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.061316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.066981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 464/935] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:15.066981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:15.090999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 472/936] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:15.090999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354e78-598a-4b07-9100-53a3e7d04d38 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:15.131584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:15.186966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:15.198129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354e78-598a-4b07-9100-53a3e7d04d38 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.200604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979766b5-1885-4c2f-bcbf-f5c8dfe1b8b3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.233201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.233900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.234250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.234586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.235355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:15.235731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.236319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.237059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.237288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.237478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.237825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/08b3612fd73644c99e1d8aeb8af68411/roles/34985ab104fa493390d2eaf8eb613c4a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.240294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=08b3612fd73644c99e1d8aeb8af68411, role_id=34985ab104fa493390d2eaf8eb613c4a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.241780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.247130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 473/937] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:15.247130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:15.261734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 465/938] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:25:15 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/08b3612fd73644c99e1d8aeb8af68411/roles/34985ab104fa493390d2eaf8eb613c4a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:25:15.262584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:15.387455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c1bf8-7060-4c64-a87d-1967e11c60e2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.390785 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:15.396493 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b713a-08a8-4da2-8e1a-1f47cbdead8e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.427590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.430076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.430076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.430076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.430076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.432209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.450918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.451863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.452294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.452702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.453476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.455491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.457663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 466/939] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:15.467112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:15.468487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:15.469575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:15.472298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 474/940] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:15.480090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:15.615940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de5f6-59df-4a8b-bd5f-d5a1bbe813a0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.654963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.655529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.655806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.656074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.656745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:15.657044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.658414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.663559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 467/941] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:15.670532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:15.695490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:15.782077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14090-efce-44ca-8c79-bd9fb6cc0e29 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.816806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.817685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.818116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.818569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.819428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:15.819912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.821775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.827432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 475/942] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:15.834672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:15.859960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:15.947990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35c655-69b4-4e26-a63e-19a36b648cdb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:15.984253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea966ce7-15f7-4ae4-b563-a3142a7db1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:15.985165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966ce7-15f7-4ae4-b563-a3142a7db1ae None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:15.985674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966ce7-15f7-4ae4-b563-a3142a7db1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:15.986212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966ce7-15f7-4ae4-b563-a3142a7db1ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:15.987149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea966ce7-15f7-4ae4-b563-a3142a7db1ae None admin] RBAC: Adding query filter params (interface=public, service_id=6c88d4ab9c4d48afb57092d296d2d939, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:15.987608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea966ce7-15f7-4ae4-b563-a3142a7db1ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:15.989136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea966ce7-15f7-4ae4-b563-a3142a7db1ae None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:15.995963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 468/943] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:25:15 2022] GET /identity/v3/endpoints?service_id=6c88d4ab9c4d48afb57092d296d2d939&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:16.001693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:16.097456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:16.113547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ef09-7ad8-4108-afbc-f871644a8a5f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:16.148694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3639990-fb17-4180-bead-d514df233876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:16.149978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639990-fb17-4180-bead-d514df233876 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:16.150258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639990-fb17-4180-bead-d514df233876 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:16.150532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639990-fb17-4180-bead-d514df233876 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:16.151210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3639990-fb17-4180-bead-d514df233876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:16.152588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3639990-fb17-4180-bead-d514df233876 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:16.159012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 476/944] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:25:16 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:25:16.334179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb333-764c-4164-b8b7-f6473993e141 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:16.334707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb333-764c-4164-b8b7-f6473993e141 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:16.335182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb333-764c-4164-b8b7-f6473993e141 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:16.338089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 469/945] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:16.343402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6e8-9a8a-4e59-bc90-e0d8fe50fc7e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:16.343815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6e8-9a8a-4e59-bc90-e0d8fe50fc7e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:16.344196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6e8-9a8a-4e59-bc90-e0d8fe50fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:16.363125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ec72c6e8-9a8a-4e59-bc90-e0d8fe50fc7e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:16.364478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ec72c6e8-9a8a-4e59-bc90-e0d8fe50fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:16.447049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 477/946] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:16.470058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb333-764c-4164-b8b7-f6473993e141 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:16.560054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:16.578281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb333-764c-4164-b8b7-f6473993e141 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:16.614274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b05d-6921-4006-8964-f01602510294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:16.615253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b05d-6921-4006-8964-f01602510294 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:16.615764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b05d-6921-4006-8964-f01602510294 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:16.616239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b05d-6921-4006-8964-f01602510294 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:16.617128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b05d-6921-4006-8964-f01602510294 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:16.619990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b05d-6921-4006-8964-f01602510294 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:16.622913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING keystone.server.flask.common [None req-0294b05d-6921-4006-8964-f01602510294 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 31 18:25:16.646555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-0294b05d-6921-4006-8964-f01602510294 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 18:25:16.646555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 18:25:16.646555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [parameters: {'id': '5dd79c3c6d104a84a791092bba7c5a90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 18:25:16.646555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0294b05d-6921-4006-8964-f01602510294 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dd79c3c6d104a84a791092bba7c5a90.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dd79c3c6d104a84a791092bba7c5a90. Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 18:25:16.665991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 31 18:25:16.666907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jul 31 18:25:16.667923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 18:25:16.668849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 18:25:16.669895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 18:25:16.670714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'id': '5dd79c3c6d104a84a791092bba7c5a90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:16.673470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:16.679314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dd79c3c6d104a84a791092bba7c5a90. Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:16.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 470/947] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Jul 31 18:25:16 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:16.687003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c6e8-9a8a-4e59-bc90-e0d8fe50fc7e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:16.770704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:16.794659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c6e8-9a8a-4e59-bc90-e0d8fe50fc7e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:16.833379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb82c9-5f55-454a-90de-39b3b54bf32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:16.834525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb82c9-5f55-454a-90de-39b3b54bf32b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:16.835068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb82c9-5f55-454a-90de-39b3b54bf32b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:16.835558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb82c9-5f55-454a-90de-39b3b54bf32b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:16.844004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb82c9-5f55-454a-90de-39b3b54bf32b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:16.845717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb82c9-5f55-454a-90de-39b3b54bf32b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-59fb82c9-5f55-454a-90de-39b3b54bf32b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:16.858065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:16.859105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:16.860105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:16.866058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 478/948] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:16.869519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b05d-6921-4006-8964-f01602510294 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:16.975378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b05d-6921-4006-8964-f01602510294 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:17.011809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99230-d033-4be8-b579-474c0e962d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:17.012440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99230-d033-4be8-b579-474c0e962d55 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.012719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99230-d033-4be8-b579-474c0e962d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.012992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99230-d033-4be8-b579-474c0e962d55 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.013965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99230-d033-4be8-b579-474c0e962d55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:17.014269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99230-d033-4be8-b579-474c0e962d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:17.015939 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99230-d033-4be8-b579-474c0e962d55 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:17.031326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:17.037629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 471/949] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:17.371890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20348a-c629-4922-8f22-7cb061f7e560 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.372959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20348a-c629-4922-8f22-7cb061f7e560 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.373483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20348a-c629-4922-8f22-7cb061f7e560 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.375588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 479/950] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:17.380911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aceb5-ce19-471a-9ccf-9f2d06a8df3b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.381699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aceb5-ce19-471a-9ccf-9f2d06a8df3b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.382191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aceb5-ce19-471a-9ccf-9f2d06a8df3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.403050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a74aceb5-ce19-471a-9ccf-9f2d06a8df3b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:17.404573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a74aceb5-ce19-471a-9ccf-9f2d06a8df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:17.483516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 472/951] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:17.505433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20348a-c629-4922-8f22-7cb061f7e560 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:17.573726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39236-d7cf-4391-9870-bed63c0d926b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.574832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39236-d7cf-4391-9870-bed63c0d926b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.575710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39236-d7cf-4391-9870-bed63c0d926b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.578092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 473/952] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:17.583297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839af5-a4b7-471a-8e47-9e2853fd8d77 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.583812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839af5-a4b7-471a-8e47-9e2853fd8d77 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.584298 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839af5-a4b7-471a-8e47-9e2853fd8d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.603942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8b839af5-a4b7-471a-8e47-9e2853fd8d77 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:17.605483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b839af5-a4b7-471a-8e47-9e2853fd8d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:17.619770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20348a-c629-4922-8f22-7cb061f7e560 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:17.659034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:17.659622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.659905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.660181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.668875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:17.673340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:17.679365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:17.681395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:17.682501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:17.684499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 474/953] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:17.684818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 480/954] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Jul 31 18:25:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:17.694954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b839af5-a4b7-471a-8e47-9e2853fd8d77 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:17.706777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:17.765574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:17.811927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b839af5-a4b7-471a-8e47-9e2853fd8d77 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:17.854882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05e81-f52e-4f9a-9e87-a35b00ff779f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:17.858409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:17.859273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.859738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.860212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.861124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:17.861626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:17.863640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:17.876221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 475/955] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Jul 31 18:25:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:17.881983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:17.896917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:17.897733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:17.898011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:17.898277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:17.899448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:17.900813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:17.911719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:17.912879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:17.913749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 481/956] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:17.919296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:17.999473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.021534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7c19-f6bf-41e5-ae73-c669b26bd810 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.046957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3b52-1049-4577-8433-418b859ad46f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.053085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.077837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.078489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.078779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.079069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.092658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.094116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.097807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.098685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.099298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.099786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.101229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:18.102413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.105145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:18.110841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:18.111897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:18.112817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:18.112817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:18.112817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:18.112817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:18.114688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 482/957] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:18.118976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 476/958] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:18.120117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.121482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.236270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bd6d9-ccd5-4a43-85a4-7d951dc5bc69 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.247879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c9245-ba7c-4fb2-9d67-c9dcbd3d8468 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.283376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.293464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.294364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.294754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b57810-7e55-4c4e-b4c7-8c8ad5e8c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.295157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.295413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57810-7e55-4c4e-b4c7-8c8ad5e8c386 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.295689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57810-7e55-4c4e-b4c7-8c8ad5e8c386 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.295960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57810-7e55-4c4e-b4c7-8c8ad5e8c386 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.296263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.296646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b57810-7e55-4c4e-b4c7-8c8ad5e8c386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:18.296945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b57810-7e55-4c4e-b4c7-8c8ad5e8c386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.297557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:18.298066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.298384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b57810-7e55-4c4e-b4c7-8c8ad5e8c386 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.300171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.306568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 477/959] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:18.312513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 483/960] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:18.318977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.336218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9392-bd91-4a0e-b74d-6a6ea1554654 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.336515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9392-bd91-4a0e-b74d-6a6ea1554654 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.336810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9392-bd91-4a0e-b74d-6a6ea1554654 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.340392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 484/961] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:18.344016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c0eb-0710-4ba7-94f0-0796be150e95 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.344305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c0eb-0710-4ba7-94f0-0796be150e95 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.344600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c0eb-0710-4ba7-94f0-0796be150e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.364539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fdc9c0eb-0710-4ba7-94f0-0796be150e95 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:18.365783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fdc9c0eb-0710-4ba7-94f0-0796be150e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:18.373519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.443550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb281-72d1-4de7-b32f-59f38e6fbebc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.455349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 485/962] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:18.471080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c0eb-0710-4ba7-94f0-0796be150e95 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.483494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.484236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.484584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.484857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.493506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.494889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:18.512409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:18.513941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:18.516218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 478/963] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:18.520237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.591694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c0eb-0710-4ba7-94f0-0796be150e95 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.609150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.628696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.629233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.629694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.630242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.630242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.630845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.632241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.637779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85670b99-5afa-44b2-890e-1dba846b56ec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:18.645475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:18.646513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:18.647425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 486/964] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:18.655156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.681468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.682531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.683142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.683648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.684850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:18.685377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.687162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.707204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 479/965] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:18.713595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.760210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1fa21-c778-46a7-b64f-db152715e1d3 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.795315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.795966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.796241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.796511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.797178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:18.797477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.798839 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.804078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 487/966] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:18.811969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:18.845285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c611-a329-4bd1-a0aa-c82cfd702744 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.862836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.895533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.897072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.897369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.897650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.935048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfe1b-5405-45f5-b994-272d74e5d558 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:18.971331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:18.979412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:18.980149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:18.981068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:18.981451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:18.981836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.982372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:18.982749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:18.983705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.984314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:18.999074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 488/967] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:19.000442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.098350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 480/968] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:19.108103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.116425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b479d-da9c-4dbd-bced-31388d7ad402 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:19.126554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:19.154956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dcc09-67fb-47e8-b358-c4a5de83a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:19.155695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dcc09-67fb-47e8-b358-c4a5de83a5a3 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.156043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dcc09-67fb-47e8-b358-c4a5de83a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.156381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dcc09-67fb-47e8-b358-c4a5de83a5a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.157169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dcc09-67fb-47e8-b358-c4a5de83a5a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:19.158606 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dcc09-67fb-47e8-b358-c4a5de83a5a3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:19.174703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:19.191115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 489/969] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:19.235438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68c331-f8e6-433e-827b-df90bd357aeb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:19.282977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:19.283917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.284362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.284802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.296570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:19.298391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:19.302684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925d6bd-7cd1-41c1-a3ab-9f97f5ba89be None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.303140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925d6bd-7cd1-41c1-a3ab-9f97f5ba89be None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.303520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925d6bd-7cd1-41c1-a3ab-9f97f5ba89be None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.310145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 490/970] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:19.312093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f919d-b67c-4c98-bfc1-9591d58ae178 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.312476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f919d-b67c-4c98-bfc1-9591d58ae178 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.312856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f919d-b67c-4c98-bfc1-9591d58ae178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:19.317746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:19.318859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:19.320017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:19.320017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:19.320017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:19.320017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:19.322671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 481/971] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:19.328607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.336813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a10f919d-b67c-4c98-bfc1-9591d58ae178 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:19.338213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a10f919d-b67c-4c98-bfc1-9591d58ae178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:19.429003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 491/972] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:19.456171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f919d-b67c-4c98-bfc1-9591d58ae178 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.462609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9490b-f2b7-4f79-8082-c7d89e726440 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:19.466104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:19.506680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:19.507360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.507645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.508278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.508982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:19.509289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:19.511233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:19.528070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 482/973] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:19.534794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.580901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:19.591784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f919d-b67c-4c98-bfc1-9591d58ae178 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:19.630190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:19.630863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.631179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.631450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.632170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:19.633743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:19.636373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING keystone.server.flask.common [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 31 18:25:19.649735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.sql.core [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 18:25:19.649735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 18:25:19.649735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [parameters: {'user_id': 'a4db6d494c3b442e95043969fd89e23e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 18:25:19.649735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80136) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application conn.query(q) Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result.read() Jul 31 18:25:19.656732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 18:25:19.657687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application next(self.gen) Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application yield resource Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application next(self.gen) Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise self.value Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application session.commit() Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 18:25:19.658845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.session.flush() Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application compat.raise_( Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 18:25:19.659982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 18:25:19.660966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application conn.query(q) Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application result.read() Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 18:25:19.661854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a4db6d494c3b442e95043969fd89e23e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:19.664083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 31 18:25:19.667039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 492/974] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Jul 31 18:25:19 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:19.669541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.677202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253d07-f16c-4deb-9c4a-ef7f5b2a4f1a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:19.717423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:19.718434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.719035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.719606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.728140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:19.729935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:19.743404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:19.744338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:19.745294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:19.747873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 483/975] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:19.754899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.782416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:19.787846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897f2e9-4ea3-46a8-a04c-3974ece2a5f6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:19.828526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:19.829562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.829988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.830417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.838778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:19.840734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:19.855030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:19.856240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 18:25:19.857357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:19.860290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b60ab-c496-492c-8ae5-5c1f0367c5e9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:19.861051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 493/976] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:25:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:19.871924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:19.895431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:19.896056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:19.896337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:19.896608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:19.897353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:19.897716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:19.899541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:19.903137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:19.912446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 484/977] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:19.925338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:20.000084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165475d5-9c6f-4277-a199-99f3af305ca6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:20.026003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:20.041023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d671253-9e7e-4f8d-b1b4-345f597183d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:20.041996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671253-9e7e-4f8d-b1b4-345f597183d2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:20.042418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671253-9e7e-4f8d-b1b4-345f597183d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:20.042833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671253-9e7e-4f8d-b1b4-345f597183d2 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:20.043770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d671253-9e7e-4f8d-b1b4-345f597183d2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:20.044216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d671253-9e7e-4f8d-b1b4-345f597183d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:20.044698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb957419-1ac2-45ff-975f-5d496a89d652 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:20.045965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d671253-9e7e-4f8d-b1b4-345f597183d2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:20.080433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49715d1-c90c-4743-8ee6-85fd0cd13686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:20.081135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49715d1-c90c-4743-8ee6-85fd0cd13686 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:20.081416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49715d1-c90c-4743-8ee6-85fd0cd13686 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:20.081742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49715d1-c90c-4743-8ee6-85fd0cd13686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:20.082633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49715d1-c90c-4743-8ee6-85fd0cd13686 None admin] RBAC: Adding query filter params (role.id=34985ab104fa493390d2eaf8eb613c4a, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=08b3612fd73644c99e1d8aeb8af68411) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:20.082962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49715d1-c90c-4743-8ee6-85fd0cd13686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:20.084481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49715d1-c90c-4743-8ee6-85fd0cd13686 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:20.089066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 494/978] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Jul 31 18:25:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:20.099061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 485/979] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:19 2022] GET /identity/v3/role_assignments?user.id=08b3612fd73644c99e1d8aeb8af68411&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=34985ab104fa493390d2eaf8eb613c4a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:20.393675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301cd00-0e6b-4dda-b51c-4a8fb0d2a976 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:20.393919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301cd00-0e6b-4dda-b51c-4a8fb0d2a976 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:20.394150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301cd00-0e6b-4dda-b51c-4a8fb0d2a976 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:20.395698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 495/980] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:20.400637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa1d3-f489-44ab-831e-fa1834c1cc02 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:20.400923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa1d3-f489-44ab-831e-fa1834c1cc02 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:20.401190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa1d3-f489-44ab-831e-fa1834c1cc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:20.419395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-032fa1d3-f489-44ab-831e-fa1834c1cc02 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:20.420572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-032fa1d3-f489-44ab-831e-fa1834c1cc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:20.497933 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 486/981] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:20.519734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301cd00-0e6b-4dda-b51c-4a8fb0d2a976 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:20.604090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:20.631322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301cd00-0e6b-4dda-b51c-4a8fb0d2a976 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:20.665329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fcc77-512b-4d56-9e82-23f88f19d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:20.665873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fcc77-512b-4d56-9e82-23f88f19d740 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:20.666146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fcc77-512b-4d56-9e82-23f88f19d740 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:20.666412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fcc77-512b-4d56-9e82-23f88f19d740 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:20.667129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fcc77-512b-4d56-9e82-23f88f19d740 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:20.668500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fcc77-512b-4d56-9e82-23f88f19d740 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:20.684194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 496/982] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:25:20 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:21.352414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da27b-6a8d-47a7-ac13-17d1d0fffa35 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:21.353032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da27b-6a8d-47a7-ac13-17d1d0fffa35 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:21.353032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da27b-6a8d-47a7-ac13-17d1d0fffa35 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:21.354343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 487/983] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:21.359392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6f061-600a-44de-b058-5a5cdf2731b1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:21.359676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6f061-600a-44de-b058-5a5cdf2731b1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:21.359948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6f061-600a-44de-b058-5a5cdf2731b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:21.378209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a6f6f061-600a-44de-b058-5a5cdf2731b1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:21.379726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a6f6f061-600a-44de-b058-5a5cdf2731b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:21.457170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 497/984] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:21.479773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86da27b-6a8d-47a7-ac13-17d1d0fffa35 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:21.561555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:21.584882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86da27b-6a8d-47a7-ac13-17d1d0fffa35 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:21.619303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:21.619885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:21.620162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:21.620430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:21.621046 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:21.622408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:21.631250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:21.632300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:21.633328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 488/985] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:21.640642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6f061-600a-44de-b058-5a5cdf2731b1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:21.699749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:21.744329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6f061-600a-44de-b058-5a5cdf2731b1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:21.779154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:21.779781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:21.780056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:21.780324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:21.780987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:21.781287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:21.782648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:21.787897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 498/986] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:21.793895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:21.901993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3548e-45ad-42d6-90e8-b99f8dbd77af None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:21.934744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:21.935394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:21.935673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:21.935944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:21.936610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:21.936928 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:21.938283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:21.948426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 489/987] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:21.949671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:22.050826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6005e8-af02-4498-b399-36ab71c587e0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:22.075335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:22.087550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c65e5-6bdb-4303-bb41-f82ef41204a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:22.088170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c65e5-6bdb-4303-bb41-f82ef41204a6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.088443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c65e5-6bdb-4303-bb41-f82ef41204a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.088713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c65e5-6bdb-4303-bb41-f82ef41204a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.089458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c65e5-6bdb-4303-bb41-f82ef41204a6 None admin] RBAC: Adding query filter params (interface=admin, service_id=6c88d4ab9c4d48afb57092d296d2d939, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:22.089762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c65e5-6bdb-4303-bb41-f82ef41204a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:22.091148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c65e5-6bdb-4303-bb41-f82ef41204a6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:22.100448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 499/988] 10.222.0.20 () {56 vars in 1249 bytes} [Sun Jul 31 18:25:21 2022] GET /identity/v3/endpoints?service_id=6c88d4ab9c4d48afb57092d296d2d939&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:22.102225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:22.112787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:22.172096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a842cb8-0ce8-476c-b806-114fc3e3b670 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.172301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a842cb8-0ce8-476c-b806-114fc3e3b670 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.172583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a842cb8-0ce8-476c-b806-114fc3e3b670 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.173924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 500/989] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:22.178696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70479-243b-44d2-80e4-5c2c4a975b3c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.179018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70479-243b-44d2-80e4-5c2c4a975b3c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.179300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70479-243b-44d2-80e4-5c2c4a975b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.198007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1ac70479-243b-44d2-80e4-5c2c4a975b3c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:22.199222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1ac70479-243b-44d2-80e4-5c2c4a975b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:22.209081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c89c-06ab-498e-9a56-761cb9b0b5a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:22.245761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:22.246384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.246665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.246967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.247611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:22.248979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:22.263155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 490/990] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:25:22 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:25:22.270574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 501/991] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:22.293301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:22.371274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:22.408747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b30401-8454-4f7e-96ab-18431c81d256 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:22.450239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:22.450892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.451210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.451484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] PATH_INFO: `/v3/services/image` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.452117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:22.453490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:22.463115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:22.464107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:22.464972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 491/992] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Jul 31 18:25:22 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:22.470156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac70479-243b-44d2-80e4-5c2c4a975b3c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:22.571357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac70479-243b-44d2-80e4-5c2c4a975b3c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:22.589443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:22.608167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedf518-3b02-4e63-a157-ea3a11a3474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:22.608799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf518-3b02-4e63-a157-ea3a11a3474a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.609079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf518-3b02-4e63-a157-ea3a11a3474a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.609412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf518-3b02-4e63-a157-ea3a11a3474a None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.610095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedf518-3b02-4e63-a157-ea3a11a3474a None admin] RBAC: Adding query filter params (name=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:22.610399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedf518-3b02-4e63-a157-ea3a11a3474a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:22.611790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedf518-3b02-4e63-a157-ea3a11a3474a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:22.621434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 502/993] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:22.622689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:22.723631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c2f1-1205-4e69-86dd-88c88b1e3669 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:22.726956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07974a-6ac1-4097-be61-b78e46f7bd1a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.727428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07974a-6ac1-4097-be61-b78e46f7bd1a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.727616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07974a-6ac1-4097-be61-b78e46f7bd1a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.729108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 503/994] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:22.734001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5abd67-e004-4ae4-82ef-859a008e4ffc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.734292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5abd67-e004-4ae4-82ef-859a008e4ffc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.734574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5abd67-e004-4ae4-82ef-859a008e4ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.752644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6d5abd67-e004-4ae4-82ef-859a008e4ffc None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:22.753836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6d5abd67-e004-4ae4-82ef-859a008e4ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:22.758802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:22.759449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:22.759732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:22.760003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:22.760677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:22.760983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:22.762353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:22.763906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:22.770080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 492/995] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:22.840735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 504/996] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:22.863420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:22.972332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ec479-496f-4573-ba66-63ee41ba3870 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:23.008476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:23.009124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:23.009408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:23.009682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:23.010304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:23.011711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:23.021198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:23.022218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:23.023579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 493/997] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:23.028760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5abd67-e004-4ae4-82ef-859a008e4ffc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:23.128345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5abd67-e004-4ae4-82ef-859a008e4ffc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:23.141788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:23.164021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:23.165375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:23.165657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:23.165934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:23.166608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:23.166915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:23.168326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:23.173308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 505/998] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:23.178731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:23.244092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:23.287376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13982369-3634-4df2-a7d7-1ff6fd520561 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:23.321602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:23.322229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:23.322513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:23.322789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:23.323491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:23.323797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:23.325183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:23.337389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 494/999] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:23.337573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:23.449308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb7f9c-d086-4c32-9273-641293c1be1d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:23.485332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b909806-5d0e-4976-b8ea-e65f0c94ae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:23.485953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909806-5d0e-4976-b8ea-e65f0c94ae13 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:23.486233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909806-5d0e-4976-b8ea-e65f0c94ae13 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:23.486506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909806-5d0e-4976-b8ea-e65f0c94ae13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:23.487288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909806-5d0e-4976-b8ea-e65f0c94ae13 None admin] RBAC: Adding query filter params (interface=public, service_id=cd24cfb08aa7435988f099906a0688f9, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:23.487598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909806-5d0e-4976-b8ea-e65f0c94ae13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:23.488960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909806-5d0e-4976-b8ea-e65f0c94ae13 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:23.499556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 506/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:25:23 2022] GET /identity/v3/endpoints?service_id=cd24cfb08aa7435988f099906a0688f9&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:23.501101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:23.605461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f633f-47fa-43a3-8027-9da10abce26d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:23.630036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:23.640890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962eba3-08b1-402e-b64f-1f8ab94146c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:23.641507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962eba3-08b1-402e-b64f-1f8ab94146c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:23.641789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962eba3-08b1-402e-b64f-1f8ab94146c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:23.642065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962eba3-08b1-402e-b64f-1f8ab94146c5 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:23.642706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962eba3-08b1-402e-b64f-1f8ab94146c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:23.644122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962eba3-08b1-402e-b64f-1f8ab94146c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:23.651537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 495/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:25:23 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:25:24.299767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c262-8396-46a3-98c7-26faa95b23ed None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:24.300298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c262-8396-46a3-98c7-26faa95b23ed None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:24.300298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c262-8396-46a3-98c7-26faa95b23ed None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:24.301803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 507/1002] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:24.307794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614415-4e99-45c8-a0e3-223756812adb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:24.308086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614415-4e99-45c8-a0e3-223756812adb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:24.308364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614415-4e99-45c8-a0e3-223756812adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:24.326494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-52614415-4e99-45c8-a0e3-223756812adb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:24.327699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-52614415-4e99-45c8-a0e3-223756812adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:24.395047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 496/1003] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:24.417389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c262-8396-46a3-98c7-26faa95b23ed None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:24.468230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:24.529239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c262-8396-46a3-98c7-26faa95b23ed None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:24.563401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:24.563960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:24.564236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:24.564503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:24.565126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:24.566484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:24.575752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:24.576743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:24.582987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 508/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Jul 31 18:25:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:24.585325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614415-4e99-45c8-a0e3-223756812adb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:24.686959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614415-4e99-45c8-a0e3-223756812adb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:24.707523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:24.723601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195a800-bbb9-40a3-804f-411cd30c92b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:24.724227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a800-bbb9-40a3-804f-411cd30c92b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:24.724509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a800-bbb9-40a3-804f-411cd30c92b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:24.724781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a800-bbb9-40a3-804f-411cd30c92b6 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:24.725452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a800-bbb9-40a3-804f-411cd30c92b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:24.725755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a800-bbb9-40a3-804f-411cd30c92b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:24.727211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a800-bbb9-40a3-804f-411cd30c92b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:24.732263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 497/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:24.737680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:24.805663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fa67e-01bf-4c9a-964d-86c0b33e37c5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:24.806079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fa67e-01bf-4c9a-964d-86c0b33e37c5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:24.806354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fa67e-01bf-4c9a-964d-86c0b33e37c5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:24.807901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 498/1006] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:24.812699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccd2c2-3e58-4174-aa02-4f0706aa16e2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:24.812978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccd2c2-3e58-4174-aa02-4f0706aa16e2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:24.813246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccd2c2-3e58-4174-aa02-4f0706aa16e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:24.831913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-58ccd2c2-3e58-4174-aa02-4f0706aa16e2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:24.833019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58ccd2c2-3e58-4174-aa02-4f0706aa16e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:24.844209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec407-6f85-48bc-bd72-c1ef14699861 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:24.846509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:24.879899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:24.880511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:24.880789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:24.881056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:24.881718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:24.882015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:24.884043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:24.889193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 509/1007] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Jul 31 18:25:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:24.894594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:24.914996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 499/1008] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:24.934427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccd2c2-3e58-4174-aa02-4f0706aa16e2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:24.997774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5782-d51c-4953-b265-9bb25ab51451 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:25.033158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405cf7a-c7fb-42cf-b5e1-408f6ecd1a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:25.033774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405cf7a-c7fb-42cf-b5e1-408f6ecd1a82 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:25.034048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405cf7a-c7fb-42cf-b5e1-408f6ecd1a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:25.034535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405cf7a-c7fb-42cf-b5e1-408f6ecd1a82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:25.035033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405cf7a-c7fb-42cf-b5e1-408f6ecd1a82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:25.036388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405cf7a-c7fb-42cf-b5e1-408f6ecd1a82 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:25.050698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccd2c2-3e58-4174-aa02-4f0706aa16e2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:25.054384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 510/1009] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:25:25.067730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:25.099607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d4377-ebe1-42ab-9245-039ea25a9e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:25.100273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4377-ebe1-42ab-9245-039ea25a9e54 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:25.100557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4377-ebe1-42ab-9245-039ea25a9e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:25.100829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4377-ebe1-42ab-9245-039ea25a9e54 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:25.101580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d4377-ebe1-42ab-9245-039ea25a9e54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:25.103120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d4377-ebe1-42ab-9245-039ea25a9e54 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:25.130961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 500/1010] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:25:24 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:25:25.667916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823a31-48f1-4568-a8dd-6989c2383d5e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:25.668465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823a31-48f1-4568-a8dd-6989c2383d5e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:25.668465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823a31-48f1-4568-a8dd-6989c2383d5e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:25.669840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 511/1011] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:25.674807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee4bf-bc38-4824-a7d8-f9d9f74ef3cf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:25.675245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee4bf-bc38-4824-a7d8-f9d9f74ef3cf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:25.675433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee4bf-bc38-4824-a7d8-f9d9f74ef3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:25.694130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ca0ee4bf-bc38-4824-a7d8-f9d9f74ef3cf None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:25.695362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca0ee4bf-bc38-4824-a7d8-f9d9f74ef3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:25.769254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 501/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:25 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:25.791948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823a31-48f1-4568-a8dd-6989c2383d5e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:25.821208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:25.897088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823a31-48f1-4568-a8dd-6989c2383d5e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:25.930779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:25.931441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:25.931716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:25.931983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:25.932594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:25.933949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:25.942627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:25.943865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 18:25:25.945769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:25.947186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 512/1013] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:25.950572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ee4bf-bc38-4824-a7d8-f9d9f74ef3cf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:26.041889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:26.049775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ee4bf-bc38-4824-a7d8-f9d9f74ef3cf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:26.084756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:26.085372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:26.086141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:26.086434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:26.087226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:26.087530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:26.088895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:26.093803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 502/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:26.099227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:26.193603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:26.204388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beae78-d1db-4911-ab21-0bf923b91cdf None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:26.238783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940cce1-50d1-489e-9357-1c9924f34adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:26.239436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940cce1-50d1-489e-9357-1c9924f34adf None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:26.239761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940cce1-50d1-489e-9357-1c9924f34adf None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:26.239976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940cce1-50d1-489e-9357-1c9924f34adf None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:26.240707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940cce1-50d1-489e-9357-1c9924f34adf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:26.240940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940cce1-50d1-489e-9357-1c9924f34adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:26.242839 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940cce1-50d1-489e-9357-1c9924f34adf None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:26.248044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 513/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Jul 31 18:25:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:26.256667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:26.368908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec3c0-29a1-49a0-847c-f6d30538092b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:26.402359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1308d2-dc40-4307-b8f9-3bd59e8fd26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:26.403000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1308d2-dc40-4307-b8f9-3bd59e8fd26e None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:26.403284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1308d2-dc40-4307-b8f9-3bd59e8fd26e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:26.403553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1308d2-dc40-4307-b8f9-3bd59e8fd26e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:26.404258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1308d2-dc40-4307-b8f9-3bd59e8fd26e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:26.405617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1308d2-dc40-4307-b8f9-3bd59e8fd26e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:26.435029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 503/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:27.096245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03491-195d-4a81-a1f6-63193735afa6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.096801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03491-195d-4a81-a1f6-63193735afa6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.096801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03491-195d-4a81-a1f6-63193735afa6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.098296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 514/1017] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:27.104122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d91582-9574-4fb3-97ee-cf10c779a787 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.104563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d91582-9574-4fb3-97ee-cf10c779a787 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.104662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d91582-9574-4fb3-97ee-cf10c779a787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.123490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e5d91582-9574-4fb3-97ee-cf10c779a787 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:27.124684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5d91582-9574-4fb3-97ee-cf10c779a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:27.135883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:27.188986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a8c4-4b98-4e69-be41-26c191e4a54c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.189261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a8c4-4b98-4e69-be41-26c191e4a54c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.189531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a8c4-4b98-4e69-be41-26c191e4a54c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.190880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 515/1018] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:27.196222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97649-021b-4151-b208-e5e21dcd9e7c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.196442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97649-021b-4151-b208-e5e21dcd9e7c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.196716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97649-021b-4151-b208-e5e21dcd9e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.206706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 504/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:27.214616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f5c97649-021b-4151-b208-e5e21dcd9e7c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:27.215817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f5c97649-021b-4151-b208-e5e21dcd9e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:27.230679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d91582-9574-4fb3-97ee-cf10c779a787 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:27.291263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 516/1020] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:27.313965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97649-021b-4151-b208-e5e21dcd9e7c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:27.336054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d91582-9574-4fb3-97ee-cf10c779a787 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:27.372713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:27.373283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.373568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.373845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.375025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:27.376475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:27.378225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 505/1021] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:27.384279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:27.397228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:27.401313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:27.418661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97649-021b-4151-b208-e5e21dcd9e7c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:27.459535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:27.460179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.460456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.460883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] PATH_INFO: `/v3/services/image` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.461965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:27.463373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:27.472327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:27.473326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:27.474193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 517/1022] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Jul 31 18:25:27 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:27.480999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:27.497795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dbdf0-6e61-4ec8-aab3-e7e6fe6f0570 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:27.534275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:27.543098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.543098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.543098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.543098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:27.543098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:27.577959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 506/1023] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:25:27 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:25:27.607829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372973e-2dfe-431a-a199-ba2bd9c8f042 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:27.647679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:27.648779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.649063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.649335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.650081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] RBAC: Adding query filter params (name=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:27.650392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:27.651829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:27.662385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 518/1024] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:27.663395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:27.731473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:27.774208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f682b5-bdbd-4aba-9680-0648e684605d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:27.809008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265142-0768-44be-a188-19837db8f85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:27.809632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265142-0768-44be-a188-19837db8f85d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.809908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265142-0768-44be-a188-19837db8f85d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.810174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265142-0768-44be-a188-19837db8f85d None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.810835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1265142-0768-44be-a188-19837db8f85d None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:27.811174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1265142-0768-44be-a188-19837db8f85d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:27.812544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1265142-0768-44be-a188-19837db8f85d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:27.818536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 507/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:27.823846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:27.841117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:27.928719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417a44-38a6-4506-bca4-0e2e2fcf4094 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:27.962716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b946de-6b3d-49de-ab47-b2159fa998e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:27.963365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b946de-6b3d-49de-ab47-b2159fa998e5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:27.963639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b946de-6b3d-49de-ab47-b2159fa998e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:27.963906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b946de-6b3d-49de-ab47-b2159fa998e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:27.964648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b946de-6b3d-49de-ab47-b2159fa998e5 None admin] RBAC: Adding query filter params (interface=public, service_id=d14ef2750c1949de9fb83075f0358d1e, region_id=RegionOne) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:27.964953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b946de-6b3d-49de-ab47-b2159fa998e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:27.966312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b946de-6b3d-49de-ab47-b2159fa998e5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:27.975966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 519/1026] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:25:27 2022] GET /identity/v3/endpoints?service_id=d14ef2750c1949de9fb83075f0358d1e&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:27.977618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265142-0768-44be-a188-19837db8f85d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:28.078883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265142-0768-44be-a188-19837db8f85d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:28.111437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:28.123397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88092a4-84f9-4bab-9b50-ab293c8f1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:28.124026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88092a4-84f9-4bab-9b50-ab293c8f1403 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:28.124303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88092a4-84f9-4bab-9b50-ab293c8f1403 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:28.124764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88092a4-84f9-4bab-9b50-ab293c8f1403 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:28.125346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88092a4-84f9-4bab-9b50-ab293c8f1403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:28.126760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88092a4-84f9-4bab-9b50-ab293c8f1403 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:28.142967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 508/1027] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:25:27 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:25:28.640664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b360baa-ffca-4242-83cc-104a93ef5db6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:28.641207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b360baa-ffca-4242-83cc-104a93ef5db6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:28.641207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b360baa-ffca-4242-83cc-104a93ef5db6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:28.643357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 520/1028] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:28.649885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287b3b-d308-4dfa-b909-f5a7ba3ce979 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:28.650177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287b3b-d308-4dfa-b909-f5a7ba3ce979 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:28.650451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287b3b-d308-4dfa-b909-f5a7ba3ce979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:28.674302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e9287b3b-d308-4dfa-b909-f5a7ba3ce979 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:28.676139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9287b3b-d308-4dfa-b909-f5a7ba3ce979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:28.766966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 509/1029] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:28.794292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b360baa-ffca-4242-83cc-104a93ef5db6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:28.881968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:28.909408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b360baa-ffca-4242-83cc-104a93ef5db6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:28.946206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:28.946900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:28.947216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:28.947623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:28.959564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:28.965860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:28.966885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:28.967863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:28.971009 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 521/1030] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Jul 31 18:25:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:28.973361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287b3b-d308-4dfa-b909-f5a7ba3ce979 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:29.079844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287b3b-d308-4dfa-b909-f5a7ba3ce979 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:29.101135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:29.117252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:29.118011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.118390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.118763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:29.119608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:29.120014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:29.121485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:29.134144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 510/1031] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Jul 31 18:25:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:29.135712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:29.242338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dd445-5e0e-48db-ba76-8e44e7b25a4d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:29.277799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:29.278446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.278724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.279016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:29.287861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:29.292942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:29.294508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:29.311208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:29.312404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:29.313538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:29.313538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:29.313538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:29.313538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:29.314231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 522/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:29.319835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:29.425456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529683f-2ff9-4d32-bdcb-2dc95085cd5c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:29.462015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:29.462641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.462916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.463210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:29.463892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:29.464195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:29.465558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:29.483298 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 511/1033] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:29.484178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:29.585223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214635d-52cd-4922-81e9-11b2ba27a580 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:29.619263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62303cf8-0a51-4135-b41a-9abbad4a599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:29.619905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62303cf8-0a51-4135-b41a-9abbad4a599e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.620178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62303cf8-0a51-4135-b41a-9abbad4a599e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.620446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62303cf8-0a51-4135-b41a-9abbad4a599e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:29.628066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62303cf8-0a51-4135-b41a-9abbad4a599e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:29.629496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62303cf8-0a51-4135-b41a-9abbad4a599e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-62303cf8-0a51-4135-b41a-9abbad4a599e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:29.641659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:29.643154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:29.644180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 523/1034] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:25:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:29.651727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:29.697285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:29.756539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef2195-61d1-43e8-ba1e-ed958a1e201a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:29.790856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:29.791513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.791794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.792068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:29.792863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:29.793173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:29.794620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:29.797621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ca85-c591-4013-a88e-e1fcffc3f03d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.798174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ca85-c591-4013-a88e-e1fcffc3f03d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.798457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ca85-c591-4013-a88e-e1fcffc3f03d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:29.800125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 524/1035] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:29.805049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17bc94-f04d-4355-8d4a-af94c994e3dd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.805328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17bc94-f04d-4355-8d4a-af94c994e3dd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.805601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17bc94-f04d-4355-8d4a-af94c994e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:29.814917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 512/1036] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:25:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:29.820518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:29.826861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fa17bc94-f04d-4355-8d4a-af94c994e3dd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:29.828387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fa17bc94-f04d-4355-8d4a-af94c994e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:29.877377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:29.902249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 525/1037] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:29.925703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:29.927584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17bc94-f04d-4355-8d4a-af94c994e3dd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:29.929074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7acca-d935-4aa7-962d-f750d0982ae9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:29.967383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:29.967929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:29.968211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:29.968487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.036719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.038185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.040114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17bc94-f04d-4355-8d4a-af94c994e3dd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.077349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.077901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.078295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.078568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.079926 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.081319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.083163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 526/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:30.089558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.139440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:30.143733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 513/1039] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 18:25:30.145544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:30.149866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.202305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb902a-5a75-4787-865f-480388efae74 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.237708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690933da-b28f-45ca-8f8c-2c60c2e1d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.238256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690933da-b28f-45ca-8f8c-2c60c2e1d4cb None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.238539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690933da-b28f-45ca-8f8c-2c60c2e1d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.238816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690933da-b28f-45ca-8f8c-2c60c2e1d4cb None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.239529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690933da-b28f-45ca-8f8c-2c60c2e1d4cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.241004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690933da-b28f-45ca-8f8c-2c60c2e1d4cb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.251307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0e51-1c58-41c2-879c-8467d400fee8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.263548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 527/1040] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:25:30 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:25:30.268442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace577-9f72-484f-ba30-ae241292867b None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.268727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace577-9f72-484f-ba30-ae241292867b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.269005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace577-9f72-484f-ba30-ae241292867b None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.270394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 528/1041] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:30.276611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d042-f180-4279-b764-4b5eb665396d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.276976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d042-f180-4279-b764-4b5eb665396d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.277163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d042-f180-4279-b764-4b5eb665396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.296113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.296343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9fa2d042-f180-4279-b764-4b5eb665396d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:30.296845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.297123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.297448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.297554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9fa2d042-f180-4279-b764-4b5eb665396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:30.312176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.314386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:30.335679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:30.336729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:30.337679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:30.337679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:30.337679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:30.337679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:30.343124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 514/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:30.344829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.372627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 529/1043] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:30.395113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2d042-f180-4279-b764-4b5eb665396d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.409505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:30.435159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:30.470768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00b209-4804-4c0d-8b77-a48b5173022e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.512548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.513608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.513890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.514171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.514859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:30.515194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.516777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.519417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2d042-f180-4279-b764-4b5eb665396d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.530997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 515/1044] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:30.535305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.558431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.559127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.559411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.559683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] PATH_INFO: `/v3/services/image` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.560318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.561703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:30.570823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:30.572094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:30.572998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 530/1045] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:30.577847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.646233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615b9e-556a-40e1-a1e4-f3a6605c9cc8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.663410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:30.690103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.690910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.691232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.691821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.693770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:30.698371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6cef1-922a-4428-9e3a-435021e9728a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.700553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.702012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:30.714423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:30.715600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:30.716537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 516/1046] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:30.721189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.739277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.739904 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.740189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.740464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.741140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] RBAC: Adding query filter params (name=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:30.741445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.743609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.753506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 531/1047] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:30.754475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.831693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e680-35ff-4ac9-94ce-3551068e6a62 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.864625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3139549-046a-4f83-a904-6f6399917fac None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:30.868230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.868861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.869140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.869412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.870160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:30.870465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.871945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.884095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 517/1048] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:30.890157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.907413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:30.908033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:30.908314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:30.908589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:30.909317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] RBAC: Adding query filter params (type=image) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:30.909628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:30.911034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:30.916138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 532/1049] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:30.921679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:30.928065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:30.951074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:31.008057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068a4e-47f9-4bff-b289-b85c9d43669a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:31.030482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6287-3087-456a-af22-d4f2180a569d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:31.043479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead67466-2af0-4af2-911a-3bfa1059358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:31.044114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead67466-2af0-4af2-911a-3bfa1059358e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:31.044402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead67466-2af0-4af2-911a-3bfa1059358e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:31.044678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead67466-2af0-4af2-911a-3bfa1059358e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:31.045471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead67466-2af0-4af2-911a-3bfa1059358e None admin] RBAC: Adding query filter params (role.id=34985ab104fa493390d2eaf8eb613c4a, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:31.045814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead67466-2af0-4af2-911a-3bfa1059358e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:31.047284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead67466-2af0-4af2-911a-3bfa1059358e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:31.052816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 518/1050] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:30 2022] GET /identity/v3/role_assignments?user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=34985ab104fa493390d2eaf8eb613c4a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:31.080740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcc546-06db-4d2f-99ed-6b85298653d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:31.081394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc546-06db-4d2f-99ed-6b85298653d2 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:31.081674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc546-06db-4d2f-99ed-6b85298653d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:31.082005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc546-06db-4d2f-99ed-6b85298653d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:31.082676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcc546-06db-4d2f-99ed-6b85298653d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:31.084126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcc546-06db-4d2f-99ed-6b85298653d2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:31.108778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 533/1051] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:25:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:25:32.315948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20179b-f711-4a99-80e7-1868c6cbbc1d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:32.316518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20179b-f711-4a99-80e7-1868c6cbbc1d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:32.316518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20179b-f711-4a99-80e7-1868c6cbbc1d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:32.317839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 519/1052] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:32.323862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f534ac-226a-4e6d-8a72-e279cc156a05 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:32.324279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f534ac-226a-4e6d-8a72-e279cc156a05 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:32.324450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f534ac-226a-4e6d-8a72-e279cc156a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:32.342025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d1f534ac-226a-4e6d-8a72-e279cc156a05 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:32.343212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d1f534ac-226a-4e6d-8a72-e279cc156a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:32.415588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 534/1053] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:32.439325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20179b-f711-4a99-80e7-1868c6cbbc1d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:32.531641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:32.538019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20179b-f711-4a99-80e7-1868c6cbbc1d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:32.571856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:32.572417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:32.572693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:32.572964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:32.583374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:32.588383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:32.589313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:32.590169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:32.594469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 520/1054] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:32.595717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f534ac-226a-4e6d-8a72-e279cc156a05 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:32.606546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:32.701119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f534ac-226a-4e6d-8a72-e279cc156a05 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:32.734796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:32.735451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:32.735732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:32.736001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:32.736707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:32.737010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:32.738381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:32.751341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 535/1055] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:25:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:32.752922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:32.857476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968c8c2-95db-49d6-83cc-e508f9b2d28d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:32.892888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6590b-fd38-4994-bafd-dcc243bec371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:32.893529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6590b-fd38-4994-bafd-dcc243bec371 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:32.893799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6590b-fd38-4994-bafd-dcc243bec371 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:32.894069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6590b-fd38-4994-bafd-dcc243bec371 None admin] PATH_INFO: `/v3/users/978f52a497f04c71ba0d7d5792be5f56` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:32.907703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6590b-fd38-4994-bafd-dcc243bec371 None admin] RBAC: Authorizing `identity:get_user(user_id=978f52a497f04c71ba0d7d5792be5f56)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:32.909129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6590b-fd38-4994-bafd-dcc243bec371 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:32.910916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 521/1056] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:32 2022] GET /identity/v3/users/978f52a497f04c71ba0d7d5792be5f56 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:32.916673 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:32.987551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.019516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ad8b-e81c-4560-bd44-51a92df960fb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.052797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.053415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.053687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.053957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.075264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7545dc-88cb-4fa1-9c9f-11a5582860ae None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.075581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7545dc-88cb-4fa1-9c9f-11a5582860ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.075829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7545dc-88cb-4fa1-9c9f-11a5582860ae None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.077351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 522/1057] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:33.082041 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c2bc-f794-48f2-a447-7642ff0a87fc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.082334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c2bc-f794-48f2-a447-7642ff0a87fc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.082615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c2bc-f794-48f2-a447-7642ff0a87fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.100513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c563c2bc-f794-48f2-a447-7642ff0a87fc None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:33.101735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c563c2bc-f794-48f2-a447-7642ff0a87fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:33.112233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.131707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:33.134176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:33.179777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 523/1058] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:33.183890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf1a3b-aded-4fd8-9000-34eadaf1de3b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.184178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf1a3b-aded-4fd8-9000-34eadaf1de3b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.184455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf1a3b-aded-4fd8-9000-34eadaf1de3b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.185746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 524/1059] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:33.190494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75114-02b9-42db-ac93-5b67c7b25707 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.190785 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75114-02b9-42db-ac93-5b67c7b25707 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.191092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75114-02b9-42db-ac93-5b67c7b25707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.209347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cdb75114-02b9-42db-ac93-5b67c7b25707 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:33.210572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cdb75114-02b9-42db-ac93-5b67c7b25707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:33.211270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.244164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 536/1060] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:33.248166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.280632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 525/1061] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:33.281477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb75114-02b9-42db-ac93-5b67c7b25707 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.353521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7fd3-a974-420c-804a-4b9dfe4fbf79 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.360638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.385776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb75114-02b9-42db-ac93-5b67c7b25707 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.387791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.388699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.388982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.389257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.399300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:33.404118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:33.405221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 537/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:33.406085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.425082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.427096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.427096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.427096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.427472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] RBAC: Authorizing `identity:get_project(project_id=3e4b360d559f41079d721b89c47ccc46)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:33.428895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:33.431219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 526/1063] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:33.431987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.442580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.513697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fad2-71d9-44b4-8f36-036cfaa1a95d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.531245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f58e-a311-4e41-99b4-a822878c0e9a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.547521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.548140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.548420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.548695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.565828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.566445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.566722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.567028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.567734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:33.568036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:33.569398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:33.577499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 527/1064] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:33.578489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.583812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.615464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:33.617455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:33.645722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.679944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966dc2-d409-44fc-b722-cf26871b4867 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.712310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.712923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.713202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.713474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.714252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=3e4b360d559f41079d721b89c47ccc46, user.id=978f52a497f04c71ba0d7d5792be5f56) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:33.714560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:33.715214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 538/1065] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:33.716027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:33.716154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.732019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 528/1066] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/role_assignments?user.id=978f52a497f04c71ba0d7d5792be5f56&scope.project.id=3e4b360d559f41079d721b89c47ccc46&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:33.732019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.807832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.829404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b509a5a-7943-4395-8e6e-5c6095f6d901 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.845952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c658f9-f2bc-48ff-b880-8b4e7b0d8ce3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:33.859401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:33.867340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.868304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.868757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.869194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.881351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:33.883413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:33.885023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:33.885674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:33.885951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:33.886221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:33.897613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:33.899621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:33.901387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:33.902282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:33.903249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:33.903249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:33.903249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:33.903249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:33.903249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 539/1067] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:33.908252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:33.917281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:33.918239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:33.919199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:33.919199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:33.919199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:33.919199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:33.919199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 529/1068] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:33.924383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:34.020939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb293e-09f1-4874-962e-36c054da2ec5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:34.031458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ec0a-a312-4a36-9ae5-df20a690c49a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:34.051390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:34.059349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:34.059973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:34.060246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:34.060787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:34.061583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:34.061888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:34.063287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:34.068622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:34.069262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:34.069545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:34.070350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:34.071088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:34.071396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:34.072770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:34.077971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 540/1069] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:34.083147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:34.085502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 530/1070] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:34.143533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:34.207095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd3008-90d2-4a15-964d-bdb88c4ea027 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:34.245265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:34.245918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:34.246198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:34.246469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:34.253883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:34.255357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:34.267526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:34.268501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:34.269482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 541/1071] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:25:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:34.274811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:34.386782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fc28f-8172-4e5f-848a-d85a8d6b73c7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:34.420277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:34.420900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:34.421181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:34.421453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:34.422237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:34.422545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:34.424009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:34.442968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 531/1072] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:25:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:34.449417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:34.546646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812e29-af92-4f0d-ab97-5dea477449f2 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:34.548156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:34.581734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:34.582387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:34.582669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:34.582957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:34.598361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:34.603706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:34.621866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:34.622803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:34.623873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:34.623873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:34.623873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:34.623873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:34.627075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 542/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:34.628649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:34.667413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:34.727103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0d89-4f80-4b94-ab45-f3b8b3f81e4d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:34.760175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:34.760794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:34.761073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:34.761349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:34.762056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:34.762360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:34.764017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:34.775074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 532/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:34.780609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:34.879917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743b2e-8f29-4c1c-97e6-62f80fb20ff8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:34.916031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:34.916670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:34.916949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:34.917222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:34.923702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:34.925148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:34.943064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:34.943975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:34.945699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 543/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:34.950478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:35.043075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:35.047005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfc2c-3006-4d00-ac52-42d1ea204f5a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:35.079990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0fb8c-87e7-4bc5-b07b-b39e62947e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:35.080596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0fb8c-87e7-4bc5-b07b-b39e62947e9e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:35.080872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0fb8c-87e7-4bc5-b07b-b39e62947e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:35.081138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0fb8c-87e7-4bc5-b07b-b39e62947e9e None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:35.081876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0fb8c-87e7-4bc5-b07b-b39e62947e9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:35.082176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0fb8c-87e7-4bc5-b07b-b39e62947e9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:35.083624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0fb8c-87e7-4bc5-b07b-b39e62947e9e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:35.095214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 533/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:35.101264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:35.117717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:35.198425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9028635-04b1-49da-a723-785014da8c31 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:35.231078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c375531-cea0-43dd-9315-1b2bfb77dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:35.231742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c375531-cea0-43dd-9315-1b2bfb77dac9 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:35.232054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c375531-cea0-43dd-9315-1b2bfb77dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:35.232294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c375531-cea0-43dd-9315-1b2bfb77dac9 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/31e9920dd81b4f0a8a28a4e8ebef2ae2/roles/34985ab104fa493390d2eaf8eb613c4a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:35.234423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c375531-cea0-43dd-9315-1b2bfb77dac9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=31e9920dd81b4f0a8a28a4e8ebef2ae2, role_id=34985ab104fa493390d2eaf8eb613c4a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:35.235883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c375531-cea0-43dd-9315-1b2bfb77dac9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:35.249950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 544/1077] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:25:35 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/31e9920dd81b4f0a8a28a4e8ebef2ae2/roles/34985ab104fa493390d2eaf8eb613c4a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:25:35.745827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d679ec-bcd6-4f23-a68e-de08dd122c22 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:35.746389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d679ec-bcd6-4f23-a68e-de08dd122c22 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:35.746389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d679ec-bcd6-4f23-a68e-de08dd122c22 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:35.747768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 534/1078] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:35.752862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3ecb-bb78-43ff-9160-72d63da79f2f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:35.753289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3ecb-bb78-43ff-9160-72d63da79f2f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:35.753406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3ecb-bb78-43ff-9160-72d63da79f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:35.771789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ec6b3ecb-bb78-43ff-9160-72d63da79f2f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:35.773569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ec6b3ecb-bb78-43ff-9160-72d63da79f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:35.841514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 545/1079] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:35.864410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d679ec-bcd6-4f23-a68e-de08dd122c22 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:35.964132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d679ec-bcd6-4f23-a68e-de08dd122c22 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:35.999197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:35.999759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:36.000035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:36.000316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:36.010626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:36.015687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:36.016613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:36.017457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 535/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:36.023441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3ecb-bb78-43ff-9160-72d63da79f2f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:36.026614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:36.127536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3ecb-bb78-43ff-9160-72d63da79f2f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:36.165629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:36.166254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:36.166531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:36.166798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:36.167558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:36.167858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:36.169242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:36.182856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 546/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:36.184189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:36.204435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:36.287811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66039cc-d3fc-4bfc-a078-0cd22e88be35 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:36.324083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:36.324980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:36.325447 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:36.325866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] PATH_INFO: `/v3/users/978f52a497f04c71ba0d7d5792be5f56` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:36.327247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] RBAC: Authorizing `identity:get_user(user_id=978f52a497f04c71ba0d7d5792be5f56)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:36.328950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:36.331099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 536/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:36 2022] GET /identity/v3/users/978f52a497f04c71ba0d7d5792be5f56 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:36.337001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:36.407479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:36.451604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291b4f5-e9c4-49d2-9e06-a15ebeb5668d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:36.485495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f98966-11a9-4113-9c2e-7deb2c42e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:36.486220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f98966-11a9-4113-9c2e-7deb2c42e44f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:36.486503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f98966-11a9-4113-9c2e-7deb2c42e44f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:36.486776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f98966-11a9-4113-9c2e-7deb2c42e44f None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:36.487947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f98966-11a9-4113-9c2e-7deb2c42e44f None admin] RBAC: Authorizing `identity:get_project(project_id=3e4b360d559f41079d721b89c47ccc46)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:36.489385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f98966-11a9-4113-9c2e-7deb2c42e44f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:36.491068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 547/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:25:36 2022] GET /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:36.497638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:36.580043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:36.594837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9d513-4336-45a9-83ec-91b14c1bdd0b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:36.627360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebb28b-9c04-4089-8213-485f9bdd43c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:36.628021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebb28b-9c04-4089-8213-485f9bdd43c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:36.628302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebb28b-9c04-4089-8213-485f9bdd43c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:36.628577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebb28b-9c04-4089-8213-485f9bdd43c0 None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46/users/978f52a497f04c71ba0d7d5792be5f56/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:36.630508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebb28b-9c04-4089-8213-485f9bdd43c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e4b360d559f41079d721b89c47ccc46, user_id=978f52a497f04c71ba0d7d5792be5f56, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:36.632095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebb28b-9c04-4089-8213-485f9bdd43c0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:36.644531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 537/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:25:36 2022] PUT /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46/users/978f52a497f04c71ba0d7d5792be5f56/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:25:37.276406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bea2b-8ae9-49d1-8c2f-f8492c8a458b None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:37.276936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bea2b-8ae9-49d1-8c2f-f8492c8a458b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:37.276936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bea2b-8ae9-49d1-8c2f-f8492c8a458b None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:37.278337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 548/1085] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:37.283734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a774-edd3-42e0-b387-9e2be0a3a7ec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:37.284189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a774-edd3-42e0-b387-9e2be0a3a7ec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:37.284299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a774-edd3-42e0-b387-9e2be0a3a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:37.303144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2d23a774-edd3-42e0-b387-9e2be0a3a7ec None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:37.305311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2d23a774-edd3-42e0-b387-9e2be0a3a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:37.371537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 538/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:37.394512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bea2b-8ae9-49d1-8c2f-f8492c8a458b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:37.497965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bea2b-8ae9-49d1-8c2f-f8492c8a458b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:37.530678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:37.531277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:37.531552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:37.531817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:37.533596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:37.543278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:37.548043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:37.549162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:37.550312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 549/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Jul 31 18:25:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:37.555309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a774-edd3-42e0-b387-9e2be0a3a7ec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:37.629684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:37.653834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a774-edd3-42e0-b387-9e2be0a3a7ec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:37.686760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:37.687413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:37.687703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:37.687976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:37.688689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:37.688995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:37.690366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:37.703082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 539/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Jul 31 18:25:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:37.708727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:37.808986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bbdbd-01de-425c-b00f-c001a354523d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:37.842271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:37.842912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:37.843224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:37.843499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:37.853455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:37.854900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:37.869036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:37.870155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:37.871155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:37.871155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:37.871155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:37.871155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:37.871155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 550/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:37.875816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:37.974012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9db60-415b-4c61-a6cb-75532053b699 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:38.007461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:38.008340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.008627 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.008908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.009596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:38.009905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:38.011301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:38.018312 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:38.023890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 540/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:38.029435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:38.076000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:38.130159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d3c-0f97-4157-8d26-9ae6b355a5e1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:38.164703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:38.165344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.165669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.165894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.173471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:38.174909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:25:38.185977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:38.187004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:38.188010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 551/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:38.192830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:38.291501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e4165-82eb-4d49-8d19-3a0254dd30a7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:38.324030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29a1c5-0805-4481-92fe-43eb982cbc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:38.324656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a1c5-0805-4481-92fe-43eb982cbc28 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.324991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a1c5-0805-4481-92fe-43eb982cbc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.325278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a1c5-0805-4481-92fe-43eb982cbc28 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.326111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29a1c5-0805-4481-92fe-43eb982cbc28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:38.326368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29a1c5-0805-4481-92fe-43eb982cbc28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:38.327829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29a1c5-0805-4481-92fe-43eb982cbc28 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:38.345420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 541/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:38.351736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:38.453680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08bdb-7edf-4600-af4d-802ad69a8aab None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:38.460815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:38.488398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:38.489018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.489294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.489564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.555504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:38.557133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:38.628825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c5a18-3b32-48fd-ac03-a50a328c6452 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.629034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c5a18-3b32-48fd-ac03-a50a328c6452 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.629309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c5a18-3b32-48fd-ac03-a50a328c6452 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.630666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 542/1093] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:25:38.636201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53248bd-e16d-4106-813b-29949b2d796c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.636482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53248bd-e16d-4106-813b-29949b2d796c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.636757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53248bd-e16d-4106-813b-29949b2d796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.658364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 552/1094] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:38.658546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f53248bd-e16d-4106-813b-29949b2d796c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:38.658546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f53248bd-e16d-4106-813b-29949b2d796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:38.659386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:38.666689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:38.706730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:38.723694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 543/1095] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:38.748028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53248bd-e16d-4106-813b-29949b2d796c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:38.764506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3fd67-8430-46cf-8152-75862b5ea276 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:38.797860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:38.798498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.798783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.799077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.809877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:38.811442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:25:38.825851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:38.826833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:38.827804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:25:38.827804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:25:38.827804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:25:38.827804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:38.831076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 553/1096] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:38.832503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:38.845853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53248bd-e16d-4106-813b-29949b2d796c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:38.879624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:38.880192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.880472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.880750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.891808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:38.891969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:38.897006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:38.898083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:25:38.898975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 544/1097] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:38.904168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:38.939691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6063-6aca-4c25-b454-5f14d0c4e945 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:38.952334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:38.973629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:38.974254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:38.974531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:38.974815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:38.975529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:38.975873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:38.977249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:38.988860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 554/1098] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:38.994986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:39.005018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917098d-ff20-425c-ab65-6d64104ba6d8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.039627 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.040251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.040536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.040812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.041527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:39.041833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.043294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.051413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 545/1099] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:39.057784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:39.097207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eb859-f65c-477a-ad4f-98a368b64ba5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.114182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:39.132453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.132996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.133272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.133542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.140423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.141867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:25:39.154428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:39.155504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:25:39.156448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:39.156888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca383be-e2c6-43ec-8f8e-258c62100836 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.156968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 555/1100] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:25:39.161301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:39.165316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:39.190154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.190792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.191096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.191369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] PATH_INFO: `/v3/users/978f52a497f04c71ba0d7d5792be5f56` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.192520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] RBAC: Authorizing `identity:get_user(user_id=978f52a497f04c71ba0d7d5792be5f56)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.193953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.196512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 546/1101] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:39 2022] GET /identity/v3/users/978f52a497f04c71ba0d7d5792be5f56 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:39.202196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:39.259868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d9044-92d8-469a-bf5a-a3f887e2482f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.294070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.294696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.295001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.295279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.296019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:39.296332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.297768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.301567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd5e3-a390-4897-9948-9d779587fbb2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.309464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 556/1102] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:39.315482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:39.336073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.336697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.336979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.337250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.355900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:39.384739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:39.409017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.410674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.418156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b9af-1121-45d5-ba4a-d05a0cb42787 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.453786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.454410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.454683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.454970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.455745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] RBAC: Adding query filter params (role.id=34985ab104fa493390d2eaf8eb613c4a, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:39.456045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.457464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.466719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 557/1103] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:39 2022] GET /identity/v3/role_assignments?user.id=31e9920dd81b4f0a8a28a4e8ebef2ae2&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=34985ab104fa493390d2eaf8eb613c4a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:25:39.515507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 547/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 18:25:39.521851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:39.626023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8862-3ccd-423b-af23-71d8b3d882d8 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.627594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:39.664243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb6147-d8d7-4ffe-a3f4-8991749dee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.664793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb6147-d8d7-4ffe-a3f4-8991749dee02 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.665068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb6147-d8d7-4ffe-a3f4-8991749dee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.665337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb6147-d8d7-4ffe-a3f4-8991749dee02 None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.666484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb6147-d8d7-4ffe-a3f4-8991749dee02 None admin] RBAC: Authorizing `identity:get_project(project_id=3e4b360d559f41079d721b89c47ccc46)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.667948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb6147-d8d7-4ffe-a3f4-8991749dee02 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.669809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 558/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:25:39 2022] GET /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:39.675755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:39.752622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:39.776711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf5b9c-939d-40c9-8413-77a906120923 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:39.814809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9223322-c067-486b-84c9-b51217f40066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:39.815450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223322-c067-486b-84c9-b51217f40066 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:39.815727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223322-c067-486b-84c9-b51217f40066 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:39.815998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223322-c067-486b-84c9-b51217f40066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:39.816774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9223322-c067-486b-84c9-b51217f40066 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=3e4b360d559f41079d721b89c47ccc46, user.id=978f52a497f04c71ba0d7d5792be5f56) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:39.817077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9223322-c067-486b-84c9-b51217f40066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:39.818525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9223322-c067-486b-84c9-b51217f40066 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:39.825086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 548/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:39 2022] GET /identity/v3/role_assignments?user.id=978f52a497f04c71ba0d7d5792be5f56&scope.project.id=3e4b360d559f41079d721b89c47ccc46&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:41.847072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f803c-89ed-4bfc-90f8-4e6d83ed0d4a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:41.847600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f803c-89ed-4bfc-90f8-4e6d83ed0d4a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:41.847600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f803c-89ed-4bfc-90f8-4e6d83ed0d4a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:41.848980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 559/1107] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:41.854775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ac83e-a502-499f-bb30-38d66e3d8e76 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:41.855223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ac83e-a502-499f-bb30-38d66e3d8e76 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:41.855365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ac83e-a502-499f-bb30-38d66e3d8e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:41.872900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-808ac83e-a502-499f-bb30-38d66e3d8e76 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:41.874073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-808ac83e-a502-499f-bb30-38d66e3d8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:41.937443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 549/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:41.961408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f803c-89ed-4bfc-90f8-4e6d83ed0d4a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:42.061515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f803c-89ed-4bfc-90f8-4e6d83ed0d4a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:42.094250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e73306-4e1d-4c14-a1e5-4be332729d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:42.094870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e73306-4e1d-4c14-a1e5-4be332729d1f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:42.095177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e73306-4e1d-4c14-a1e5-4be332729d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:42.095448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e73306-4e1d-4c14-a1e5-4be332729d1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:42.096587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e73306-4e1d-4c14-a1e5-4be332729d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:42.098060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e73306-4e1d-4c14-a1e5-4be332729d1f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:42.099607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 560/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:42.106020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ac83e-a502-499f-bb30-38d66e3d8e76 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:42.172727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:42.203582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ac83e-a502-499f-bb30-38d66e3d8e76 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:42.236811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0868b8-0c5b-4e27-84a9-fd2b9db18121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:42.237452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0868b8-0c5b-4e27-84a9-fd2b9db18121 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:42.237734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0868b8-0c5b-4e27-84a9-fd2b9db18121 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:42.238009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0868b8-0c5b-4e27-84a9-fd2b9db18121 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:42.238694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0868b8-0c5b-4e27-84a9-fd2b9db18121 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:42.240281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0868b8-0c5b-4e27-84a9-fd2b9db18121 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:42.261784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 550/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:25:42 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:44.290213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d87c0-973e-4c88-a516-c1f769ecf04a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:44.290777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d87c0-973e-4c88-a516-c1f769ecf04a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:44.290777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d87c0-973e-4c88-a516-c1f769ecf04a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:44.292141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 561/1111] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:44.297256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28896a32-2286-4b6b-8cc1-23aeade0699d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:44.297635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28896a32-2286-4b6b-8cc1-23aeade0699d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:44.297800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28896a32-2286-4b6b-8cc1-23aeade0699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:44.316042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-28896a32-2286-4b6b-8cc1-23aeade0699d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:44.317206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28896a32-2286-4b6b-8cc1-23aeade0699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:44.381586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 551/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:25:44.405976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d87c0-973e-4c88-a516-c1f769ecf04a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:44.447186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:44.504764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d87c0-973e-4c88-a516-c1f769ecf04a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:44.537908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:44.538536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:44.538808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:44.539102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] PATH_INFO: `/v3/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:44.540560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] RBAC: Authorizing `identity:get_role(role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:44.541863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:44.543204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 562/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:44 2022] GET /identity/v3/roles/3995ac4c39964acab5ea20561b89faf8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:44.548990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28896a32-2286-4b6b-8cc1-23aeade0699d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:44.603030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:44.645746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28896a32-2286-4b6b-8cc1-23aeade0699d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:44.678289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:44.679123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:44.679405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:44.679679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] PATH_INFO: `/v3/users/403f2c39d4b84e33a3ec3554fb1692f7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:44.692448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] RBAC: Authorizing `identity:get_user(user_id=403f2c39d4b84e33a3ec3554fb1692f7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:44.693892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:44.696249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 552/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:44 2022] GET /identity/v3/users/403f2c39d4b84e33a3ec3554fb1692f7 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:44.701965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:44.799783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fc9de-71d3-4e2f-94bd-134e390dfd97 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:44.807302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:44.832626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:44.833230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:44.833505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:44.833774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:44.898266 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:44.899736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:44.994406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 563/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:45.000389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:45.096089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ced9eb-851b-4c0a-9fdc-f398d828ba59 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:45.110267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:45.131303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f993f-3a30-47dd-aae7-110c54887347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:45.132906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f993f-3a30-47dd-aae7-110c54887347 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:45.133189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f993f-3a30-47dd-aae7-110c54887347 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:45.133464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f993f-3a30-47dd-aae7-110c54887347 None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:45.134613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f993f-3a30-47dd-aae7-110c54887347 None admin] RBAC: Authorizing `identity:get_project(project_id=3e4b360d559f41079d721b89c47ccc46)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:45.136075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f993f-3a30-47dd-aae7-110c54887347 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:45.137734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 553/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:25:44 2022] GET /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:45.144119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:45.152265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:45.239176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d95fcc-7ce9-417c-8d17-19365da82ca1 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:45.272025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2dde1-e681-40bf-a8cb-9120e41a9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:45.272669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2dde1-e681-40bf-a8cb-9120e41a9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:45.272950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2dde1-e681-40bf-a8cb-9120e41a9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:45.273223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2dde1-e681-40bf-a8cb-9120e41a9ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:45.273998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2dde1-e681-40bf-a8cb-9120e41a9ee9 None admin] RBAC: Adding query filter params (role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=3e4b360d559f41079d721b89c47ccc46, user.id=403f2c39d4b84e33a3ec3554fb1692f7) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:45.274305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2dde1-e681-40bf-a8cb-9120e41a9ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:45.275754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2dde1-e681-40bf-a8cb-9120e41a9ee9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:45.281046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 564/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:45 2022] GET /identity/v3/role_assignments?user.id=403f2c39d4b84e33a3ec3554fb1692f7&scope.project.id=3e4b360d559f41079d721b89c47ccc46&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:47.236204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555309-b214-481c-8b59-7cb2b4d7ce2e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:47.236741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555309-b214-481c-8b59-7cb2b4d7ce2e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:47.236741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555309-b214-481c-8b59-7cb2b4d7ce2e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:47.238113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 554/1118] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:47.243864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237bdeb-657e-4e3f-b1e7-aeea686ae265 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:47.244306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237bdeb-657e-4e3f-b1e7-aeea686ae265 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:47.244419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237bdeb-657e-4e3f-b1e7-aeea686ae265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:47.262603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2237bdeb-657e-4e3f-b1e7-aeea686ae265 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:47.264064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2237bdeb-657e-4e3f-b1e7-aeea686ae265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:47.323744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:47.328933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 565/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:47.351581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555309-b214-481c-8b59-7cb2b4d7ce2e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:47.453086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555309-b214-481c-8b59-7cb2b4d7ce2e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:47.485594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:47.486278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:47.486505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:47.486777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] PATH_INFO: `/v3/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:47.488212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] RBAC: Authorizing `identity:get_role(role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:47.489576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:47.491510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 555/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:47 2022] GET /identity/v3/roles/3995ac4c39964acab5ea20561b89faf8 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:47.497349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237bdeb-657e-4e3f-b1e7-aeea686ae265 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:47.595216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237bdeb-657e-4e3f-b1e7-aeea686ae265 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:47.626951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:47.627591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:47.627868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:47.628137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] PATH_INFO: `/v3/users/403f2c39d4b84e33a3ec3554fb1692f7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:47.629282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] RBAC: Authorizing `identity:get_user(user_id=403f2c39d4b84e33a3ec3554fb1692f7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:47.630706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:47.632847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 566/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:47 2022] GET /identity/v3/users/403f2c39d4b84e33a3ec3554fb1692f7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:47.638849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:47.686495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:47.733408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21e5b0-7595-47c8-9c57-066d69de6d1c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:47.767453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc164-9e18-4c41-b435-c82cbc0b3760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:47.768077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc164-9e18-4c41-b435-c82cbc0b3760 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:47.768353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc164-9e18-4c41-b435-c82cbc0b3760 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:47.768621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc164-9e18-4c41-b435-c82cbc0b3760 None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:47.769754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc164-9e18-4c41-b435-c82cbc0b3760 None admin] RBAC: Authorizing `identity:get_project(project_id=3e4b360d559f41079d721b89c47ccc46)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:47.771206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc164-9e18-4c41-b435-c82cbc0b3760 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:47.773147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 556/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:25:47 2022] GET /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:47.779047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:47.844316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:47.876490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f1201-e2dd-41d3-aab1-00daecc024d0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:47.909625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4069-5780-4bb3-a165-3f9302f42f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:47.910276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4069-5780-4bb3-a165-3f9302f42f63 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:47.910550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4069-5780-4bb3-a165-3f9302f42f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:47.910818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4069-5780-4bb3-a165-3f9302f42f63 None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46/users/403f2c39d4b84e33a3ec3554fb1692f7/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:47.913710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4069-5780-4bb3-a165-3f9302f42f63 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e4b360d559f41079d721b89c47ccc46, user_id=403f2c39d4b84e33a3ec3554fb1692f7, role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:47.915187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4069-5780-4bb3-a165-3f9302f42f63 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:47.927359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 567/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:25:47 2022] PUT /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46/users/403f2c39d4b84e33a3ec3554fb1692f7/roles/3995ac4c39964acab5ea20561b89faf8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:25:49.915349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baae94-fb47-4337-93fe-e6e3203ccf5f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:49.915903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baae94-fb47-4337-93fe-e6e3203ccf5f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:49.915903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baae94-fb47-4337-93fe-e6e3203ccf5f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:49.917235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 557/1124] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:49.922282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f55eae-882e-4e8c-84e6-23a44d7589c6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:49.922718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f55eae-882e-4e8c-84e6-23a44d7589c6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:49.922819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f55eae-882e-4e8c-84e6-23a44d7589c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:49.940347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a6f55eae-882e-4e8c-84e6-23a44d7589c6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:49.941507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a6f55eae-882e-4e8c-84e6-23a44d7589c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:50.005406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 568/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:50.028066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baae94-fb47-4337-93fe-e6e3203ccf5f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:50.126381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baae94-fb47-4337-93fe-e6e3203ccf5f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:50.142892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:50.159607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:50.160232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:50.160509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:50.160779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] PATH_INFO: `/v3/roles/3995ac4c39964acab5ea20561b89faf8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:50.162179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] RBAC: Authorizing `identity:get_role(role_id=3995ac4c39964acab5ea20561b89faf8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:50.164267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:50.165651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 558/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:50 2022] GET /identity/v3/roles/3995ac4c39964acab5ea20561b89faf8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:50.171689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f55eae-882e-4e8c-84e6-23a44d7589c6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:50.236567 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:50.277591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f55eae-882e-4e8c-84e6-23a44d7589c6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:50.310610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:50.311279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:50.311561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:50.311834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] PATH_INFO: `/v3/users/403f2c39d4b84e33a3ec3554fb1692f7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:50.312987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] RBAC: Authorizing `identity:get_user(user_id=403f2c39d4b84e33a3ec3554fb1692f7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:50.314415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:50.316031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 569/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:50 2022] GET /identity/v3/users/403f2c39d4b84e33a3ec3554fb1692f7 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:50.322749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:50.421083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15487708-78ac-4a3d-bc24-265d2178c108 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:50.455546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:50.456162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:50.456442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:50.456715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:50.510170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:50.523572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:50.525029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:50.619835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 559/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:50.625659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:50.720677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321bd0-0539-40a5-bd22-63f07fdb8379 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:50.745596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:50.754356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66942b-4c4a-45ff-99b3-75e2a3bcd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:50.755006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66942b-4c4a-45ff-99b3-75e2a3bcd69b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:50.755283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66942b-4c4a-45ff-99b3-75e2a3bcd69b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:50.755552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66942b-4c4a-45ff-99b3-75e2a3bcd69b None admin] PATH_INFO: `/v3/projects/3e4b360d559f41079d721b89c47ccc46` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:50.757431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66942b-4c4a-45ff-99b3-75e2a3bcd69b None admin] RBAC: Authorizing `identity:get_project(project_id=3e4b360d559f41079d721b89c47ccc46)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:50.758856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66942b-4c4a-45ff-99b3-75e2a3bcd69b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:50.760516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 570/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:25:50 2022] GET /identity/v3/projects/3e4b360d559f41079d721b89c47ccc46 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:50.766797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:50.848099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:50.862374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cc3fd-cce6-4f07-bf6c-c962bf71e9de None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:50.895715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e434db-ab4a-407e-b297-73c3e4706618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:50.896324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e434db-ab4a-407e-b297-73c3e4706618 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:50.896606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e434db-ab4a-407e-b297-73c3e4706618 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:50.896904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e434db-ab4a-407e-b297-73c3e4706618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:50.897689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e434db-ab4a-407e-b297-73c3e4706618 None admin] RBAC: Adding query filter params (role.id=3995ac4c39964acab5ea20561b89faf8, scope.project.id=3e4b360d559f41079d721b89c47ccc46, user.id=403f2c39d4b84e33a3ec3554fb1692f7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:50.897997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e434db-ab4a-407e-b297-73c3e4706618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:50.899462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e434db-ab4a-407e-b297-73c3e4706618 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:50.905044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 560/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:50 2022] GET /identity/v3/role_assignments?user.id=403f2c39d4b84e33a3ec3554fb1692f7&scope.project.id=3e4b360d559f41079d721b89c47ccc46&role.id=3995ac4c39964acab5ea20561b89faf8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:52.909901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581191d-6dfc-4172-8f59-7bb4b48df050 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:52.910456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581191d-6dfc-4172-8f59-7bb4b48df050 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:52.910456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581191d-6dfc-4172-8f59-7bb4b48df050 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:52.911815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 571/1131] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:52.917742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5334-c9db-4049-8bb0-0d2e659cb5c2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:52.918148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5334-c9db-4049-8bb0-0d2e659cb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:52.918293 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5334-c9db-4049-8bb0-0d2e659cb5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:52.937484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6a7a5334-c9db-4049-8bb0-0d2e659cb5c2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:52.938660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6a7a5334-c9db-4049-8bb0-0d2e659cb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:53.003008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 561/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:53.026702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581191d-6dfc-4172-8f59-7bb4b48df050 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:53.123419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581191d-6dfc-4172-8f59-7bb4b48df050 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:53.155939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f9c16-b2b8-4bf6-95b9-d01256e037f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:53.156560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f9c16-b2b8-4bf6-95b9-d01256e037f2 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:53.156834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f9c16-b2b8-4bf6-95b9-d01256e037f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:53.157104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f9c16-b2b8-4bf6-95b9-d01256e037f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:53.158224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f9c16-b2b8-4bf6-95b9-d01256e037f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:53.159677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f9c16-b2b8-4bf6-95b9-d01256e037f2 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:53.161263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 572/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:53.167756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a5334-c9db-4049-8bb0-0d2e659cb5c2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:53.244102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:53.262561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a5334-c9db-4049-8bb0-0d2e659cb5c2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:53.296061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02985c-d265-43aa-9b39-0f25c9a9c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:53.296672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02985c-d265-43aa-9b39-0f25c9a9c554 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:53.296949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02985c-d265-43aa-9b39-0f25c9a9c554 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:53.297219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02985c-d265-43aa-9b39-0f25c9a9c554 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:53.297887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02985c-d265-43aa-9b39-0f25c9a9c554 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:53.299366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02985c-d265-43aa-9b39-0f25c9a9c554 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:53.324423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 562/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:25:53 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:55.372321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b82c4-1154-4fc7-97bc-b9e28b8cb5c7 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:55.372893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b82c4-1154-4fc7-97bc-b9e28b8cb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:55.372893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b82c4-1154-4fc7-97bc-b9e28b8cb5c7 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:55.374194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 573/1135] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:55.379284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5f43-4787-4c11-918a-f66ec4dc4ed6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:55.379663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5f43-4787-4c11-918a-f66ec4dc4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:55.379835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5f43-4787-4c11-918a-f66ec4dc4ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:55.398806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-55ad5f43-4787-4c11-918a-f66ec4dc4ed6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:55.400026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55ad5f43-4787-4c11-918a-f66ec4dc4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:55.465633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 563/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:55.489438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b82c4-1154-4fc7-97bc-b9e28b8cb5c7 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:55.549405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:55.588360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b82c4-1154-4fc7-97bc-b9e28b8cb5c7 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:55.620834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba200f1-0bbf-4317-ba22-f4c49e8284a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:55.621456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba200f1-0bbf-4317-ba22-f4c49e8284a0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:55.621732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba200f1-0bbf-4317-ba22-f4c49e8284a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:55.622000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba200f1-0bbf-4317-ba22-f4c49e8284a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:55.623198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba200f1-0bbf-4317-ba22-f4c49e8284a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:55.624574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba200f1-0bbf-4317-ba22-f4c49e8284a0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:55.626121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 574/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:25:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:55.632498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad5f43-4787-4c11-918a-f66ec4dc4ed6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:55.690441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:55.728651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad5f43-4787-4c11-918a-f66ec4dc4ed6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:55.761068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b7f82-06bf-41a6-976d-59d5aade06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:55.761675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7f82-06bf-41a6-976d-59d5aade06ab None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:55.761954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7f82-06bf-41a6-976d-59d5aade06ab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:55.762227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7f82-06bf-41a6-976d-59d5aade06ab None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:55.763187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b7f82-06bf-41a6-976d-59d5aade06ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:55.764611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b7f82-06bf-41a6-976d-59d5aade06ab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:55.784530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 564/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:25:55 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:25:57.792400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede809e5-49ff-47ee-9143-89bf8d3eda3f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:57.792927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede809e5-49ff-47ee-9143-89bf8d3eda3f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:57.792927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede809e5-49ff-47ee-9143-89bf8d3eda3f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:57.794298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 575/1139] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:25:57.799515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d30a8-75fd-4901-a08d-e2fb95abda47 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:57.799928 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d30a8-75fd-4901-a08d-e2fb95abda47 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:57.800037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d30a8-75fd-4901-a08d-e2fb95abda47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:57.818284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-943d30a8-75fd-4901-a08d-e2fb95abda47 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:25:57.820051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-943d30a8-75fd-4901-a08d-e2fb95abda47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:25:57.882169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 565/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:25:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:25:57.905574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede809e5-49ff-47ee-9143-89bf8d3eda3f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:58.007228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede809e5-49ff-47ee-9143-89bf8d3eda3f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:58.035186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:58.042320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:58.043037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:58.043258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:58.043527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:58.054283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:25:58.059118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:25:58.060276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:25:58.061465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 576/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:25:58.066072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d30a8-75fd-4901-a08d-e2fb95abda47 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:58.113677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:58.164801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d30a8-75fd-4901-a08d-e2fb95abda47 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:58.196595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:58.197203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:58.197476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:58.197744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:58.198447 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:58.198744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:58.200131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:58.207850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 566/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:58.214456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:58.313996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad2738-4a00-4ab1-90c5-fe06814a3c2d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:58.347277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:58.347905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:58.348180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:58.348450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] PATH_INFO: `/v3/users/e99cfe88f2454cc6aeabf1c0bd7b3244` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:58.362012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] RBAC: Authorizing `identity:get_user(user_id=e99cfe88f2454cc6aeabf1c0bd7b3244)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:58.363475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:58.365059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 577/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:25:58 2022] GET /identity/v3/users/e99cfe88f2454cc6aeabf1c0bd7b3244 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:58.371175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:58.470017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41765314-7f87-42fd-b32d-27ac39a8f9d4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:58.480097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:58.503299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:58.503914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:58.504194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:58.504467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:58.568265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:58.569655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:58.663134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 567/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:25:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:25:58.669033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:58.716072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:58.764666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a93e53-0c11-41d4-ab67-1b703422c007 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:58.796584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa71b75-2617-47fc-9856-5ec0a6e9de06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:58.797195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa71b75-2617-47fc-9856-5ec0a6e9de06 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:58.797476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa71b75-2617-47fc-9856-5ec0a6e9de06 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:58.797744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa71b75-2617-47fc-9856-5ec0a6e9de06 None admin] PATH_INFO: `/v3/projects/d30441e3209544dba90966d1f3a2eded` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:58.798868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa71b75-2617-47fc-9856-5ec0a6e9de06 None admin] RBAC: Authorizing `identity:get_project(project_id=d30441e3209544dba90966d1f3a2eded)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:58.800307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa71b75-2617-47fc-9856-5ec0a6e9de06 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:58.801942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 578/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:25:58 2022] GET /identity/v3/projects/d30441e3209544dba90966d1f3a2eded => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:25:58.808614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:25:58.820527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:25:58.904406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc43dea-7adf-4410-af8d-9c5aa0f18c78 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:25:58.937044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0227f3-e296-4cc3-b684-f2a66f60ad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:25:58.937643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0227f3-e296-4cc3-b684-f2a66f60ad2e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:25:58.937917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0227f3-e296-4cc3-b684-f2a66f60ad2e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:25:58.938183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0227f3-e296-4cc3-b684-f2a66f60ad2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:25:58.938969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0227f3-e296-4cc3-b684-f2a66f60ad2e None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=d30441e3209544dba90966d1f3a2eded, user.id=e99cfe88f2454cc6aeabf1c0bd7b3244) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:25:58.939277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0227f3-e296-4cc3-b684-f2a66f60ad2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:25:58.940688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0227f3-e296-4cc3-b684-f2a66f60ad2e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:25:58.946361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 568/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:25:58 2022] GET /identity/v3/role_assignments?user.id=e99cfe88f2454cc6aeabf1c0bd7b3244&scope.project.id=d30441e3209544dba90966d1f3a2eded&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:00.894963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf2b4d-9f22-4d6a-a293-f130b9fce297 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:00.895532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf2b4d-9f22-4d6a-a293-f130b9fce297 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:00.895532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf2b4d-9f22-4d6a-a293-f130b9fce297 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:00.897071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 579/1147] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:00.902373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb4af-cb3b-4cc9-8997-816fb0781700 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:00.902765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb4af-cb3b-4cc9-8997-816fb0781700 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:00.902922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb4af-cb3b-4cc9-8997-816fb0781700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:00.920765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dd2cb4af-cb3b-4cc9-8997-816fb0781700 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:00.921937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dd2cb4af-cb3b-4cc9-8997-816fb0781700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:00.985736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 569/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:01.008366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf2b4d-9f22-4d6a-a293-f130b9fce297 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:01.105492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf2b4d-9f22-4d6a-a293-f130b9fce297 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:01.121583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:01.139466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:01.140103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:01.140385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:01.140660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:01.151252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:26:01.156006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:26:01.157107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:26:01.157975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 580/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:26:01.163124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cb4af-cb3b-4cc9-8997-816fb0781700 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:01.166123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:01.256179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cb4af-cb3b-4cc9-8997-816fb0781700 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:01.288664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:01.289270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:01.289545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:01.289812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:01.290515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:01.290813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:01.292201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:01.299902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 570/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:01.306217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:01.404469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf32795-75cf-4df9-9c43-f7dac7841e6e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:01.437155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:01.437797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:01.438072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:01.438343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] PATH_INFO: `/v3/users/e99cfe88f2454cc6aeabf1c0bd7b3244` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:01.439521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] RBAC: Authorizing `identity:get_user(user_id=e99cfe88f2454cc6aeabf1c0bd7b3244)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:01.440943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:01.442530 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 581/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:26:01 2022] GET /identity/v3/users/e99cfe88f2454cc6aeabf1c0bd7b3244 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:01.448861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:01.511371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:01.546413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2a35-a70b-4323-bc09-90721bd2d99a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:01.577671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d4a6-c842-4fbb-a76a-6b6012eb3838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:01.578294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d4a6-c842-4fbb-a76a-6b6012eb3838 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:01.578570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d4a6-c842-4fbb-a76a-6b6012eb3838 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:01.578838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d4a6-c842-4fbb-a76a-6b6012eb3838 None admin] PATH_INFO: `/v3/projects/d30441e3209544dba90966d1f3a2eded` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:01.580005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190d4a6-c842-4fbb-a76a-6b6012eb3838 None admin] RBAC: Authorizing `identity:get_project(project_id=d30441e3209544dba90966d1f3a2eded)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:01.581420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190d4a6-c842-4fbb-a76a-6b6012eb3838 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:01.583071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 571/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:26:01 2022] GET /identity/v3/projects/d30441e3209544dba90966d1f3a2eded => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:01.589500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:01.633974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:01.686509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe74eb4-e850-421a-bd83-2b2ab4ffb85a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:01.718133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1966e48-8b7e-42dc-93ae-21b7466eef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:01.718780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966e48-8b7e-42dc-93ae-21b7466eef3f None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:01.719103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966e48-8b7e-42dc-93ae-21b7466eef3f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:01.719373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966e48-8b7e-42dc-93ae-21b7466eef3f None admin] PATH_INFO: `/v3/projects/d30441e3209544dba90966d1f3a2eded/users/e99cfe88f2454cc6aeabf1c0bd7b3244/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:01.721275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1966e48-8b7e-42dc-93ae-21b7466eef3f None admin] RBAC: Authorizing `identity:create_grant(project_id=d30441e3209544dba90966d1f3a2eded, user_id=e99cfe88f2454cc6aeabf1c0bd7b3244, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:01.722698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1966e48-8b7e-42dc-93ae-21b7466eef3f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:01.736335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 582/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:26:01 2022] PUT /identity/v3/projects/d30441e3209544dba90966d1f3a2eded/users/e99cfe88f2454cc6aeabf1c0bd7b3244/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:26:03.690664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2d8cc-de4e-4ff4-b09a-bf336f105b17 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:03.691216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2d8cc-de4e-4ff4-b09a-bf336f105b17 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:03.691216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2d8cc-de4e-4ff4-b09a-bf336f105b17 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:03.692544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 572/1154] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:03.698520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f599-f1f8-4e13-b148-d14377ebd689 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:03.698925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f599-f1f8-4e13-b148-d14377ebd689 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:03.699109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f599-f1f8-4e13-b148-d14377ebd689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:03.716630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9309f599-f1f8-4e13-b148-d14377ebd689 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:03.717793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9309f599-f1f8-4e13-b148-d14377ebd689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:03.782548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 583/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:03.805776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2d8cc-de4e-4ff4-b09a-bf336f105b17 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:03.904328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2d8cc-de4e-4ff4-b09a-bf336f105b17 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:03.936594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:03.937224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:03.937507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:03.937781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:03.939621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:03.949078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:26:03.953898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:26:03.955043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:26:03.956117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 573/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:26:03.961011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f599-f1f8-4e13-b148-d14377ebd689 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:03.993577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:04.057201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f599-f1f8-4e13-b148-d14377ebd689 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:04.089186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:04.089786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:04.090058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:04.090323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:04.091044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:04.091342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:04.092700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:04.100968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 584/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:04.106560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:04.204189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374b4a-2b9f-4292-89ac-5a6cb1caa43e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:04.237203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:04.237834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:04.238115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:04.238389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] PATH_INFO: `/v3/users/e99cfe88f2454cc6aeabf1c0bd7b3244` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:04.239558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] RBAC: Authorizing `identity:get_user(user_id=e99cfe88f2454cc6aeabf1c0bd7b3244)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:04.241149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:04.242738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 574/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:26:04 2022] GET /identity/v3/users/e99cfe88f2454cc6aeabf1c0bd7b3244 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:04.248535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:04.341516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:04.347341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4933c6-b940-4503-a0e9-7786dd1f6578 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:04.380216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:04.380840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:04.381113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:04.381387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:04.446407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:04.447902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:04.536981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:04.544422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 585/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:26:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:26:04.550068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:04.609246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:04.646708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2f2a-ba51-4502-9543-ee27c0fdf488 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:04.679382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5701e-49a7-4dc5-9641-2dc32646ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:04.680011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5701e-49a7-4dc5-9641-2dc32646ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:04.680293 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5701e-49a7-4dc5-9641-2dc32646ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:04.680568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5701e-49a7-4dc5-9641-2dc32646ceb4 None admin] PATH_INFO: `/v3/projects/d30441e3209544dba90966d1f3a2eded` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:04.681714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5701e-49a7-4dc5-9641-2dc32646ceb4 None admin] RBAC: Authorizing `identity:get_project(project_id=d30441e3209544dba90966d1f3a2eded)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:04.683180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5701e-49a7-4dc5-9641-2dc32646ceb4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:04.684822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 575/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:26:04 2022] GET /identity/v3/projects/d30441e3209544dba90966d1f3a2eded => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:04.690810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:04.785355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106341e-0a0d-4a1b-b231-e18b0e9f478c None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:04.817611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd029f-9caa-404a-be44-ab638f48ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:04.818150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd029f-9caa-404a-be44-ab638f48ee2a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:04.818423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd029f-9caa-404a-be44-ab638f48ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:04.818689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd029f-9caa-404a-be44-ab638f48ee2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:04.819992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd029f-9caa-404a-be44-ab638f48ee2a None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=d30441e3209544dba90966d1f3a2eded, user.id=e99cfe88f2454cc6aeabf1c0bd7b3244) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:04.820292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd029f-9caa-404a-be44-ab638f48ee2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:04.821702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd029f-9caa-404a-be44-ab638f48ee2a None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:04.827318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 586/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:26:04 2022] GET /identity/v3/role_assignments?user.id=e99cfe88f2454cc6aeabf1c0bd7b3244&scope.project.id=d30441e3209544dba90966d1f3a2eded&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:06.828130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca55980-a471-4a32-8858-3b8c4a74fb6f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:06.828700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca55980-a471-4a32-8858-3b8c4a74fb6f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:06.828700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca55980-a471-4a32-8858-3b8c4a74fb6f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:06.830034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 576/1162] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:06.835893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e795bb-34b3-463a-bfec-8381dc745800 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:06.836330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e795bb-34b3-463a-bfec-8381dc745800 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:06.836432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e795bb-34b3-463a-bfec-8381dc745800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:06.854820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d6e795bb-34b3-463a-bfec-8381dc745800 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:06.856024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d6e795bb-34b3-463a-bfec-8381dc745800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:06.909581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:06.921639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 587/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:06.943632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca55980-a471-4a32-8858-3b8c4a74fb6f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:07.045526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca55980-a471-4a32-8858-3b8c4a74fb6f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:07.072386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:07.078699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:07.079288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:07.079571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:07.079844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:07.143847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:07.145294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:07.239167 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 577/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:26:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:26:07.245973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e795bb-34b3-463a-bfec-8381dc745800 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:07.340074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e795bb-34b3-463a-bfec-8381dc745800 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:07.371921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c116b-dfd2-410f-a944-00735bb5be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:07.372541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c116b-dfd2-410f-a944-00735bb5be26 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:07.372816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c116b-dfd2-410f-a944-00735bb5be26 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:07.373086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c116b-dfd2-410f-a944-00735bb5be26 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:07.379420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c116b-dfd2-410f-a944-00735bb5be26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:07.380840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c116b-dfd2-410f-a944-00735bb5be26 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-6c9c116b-dfd2-410f-a944-00735bb5be26 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:26:07.392222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:26:07.393425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:26:07.394642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 588/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:26:07 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:26:07.399717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:07.429187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:07.498320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1954-05a5-4461-baf2-449c2cccbb82 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:07.531830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea462-496b-442a-a69d-c22b9f29b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:07.532445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea462-496b-442a-a69d-c22b9f29b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:07.532723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea462-496b-442a-a69d-c22b9f29b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:07.532996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea462-496b-442a-a69d-c22b9f29b6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:07.533677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea462-496b-442a-a69d-c22b9f29b6c2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:07.533982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea462-496b-442a-a69d-c22b9f29b6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:07.535382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea462-496b-442a-a69d-c22b9f29b6c2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:07.542642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 578/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Jul 31 18:26:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:09.525689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb636f-db00-4d0b-b2c4-c32cc991b30a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:09.526194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb636f-db00-4d0b-b2c4-c32cc991b30a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:09.526287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb636f-db00-4d0b-b2c4-c32cc991b30a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:09.527624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 589/1167] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:09.532741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1c79-d52d-45cf-b981-9a0f08500102 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:09.533180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1c79-d52d-45cf-b981-9a0f08500102 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:09.533300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1c79-d52d-45cf-b981-9a0f08500102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:09.551234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3fcb1c79-d52d-45cf-b981-9a0f08500102 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:09.552420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3fcb1c79-d52d-45cf-b981-9a0f08500102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:09.617227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 579/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:09.640834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb636f-db00-4d0b-b2c4-c32cc991b30a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:09.690566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:09.740316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb636f-db00-4d0b-b2c4-c32cc991b30a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:09.773853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3a420-9a05-4f3d-8dd5-4399bad8ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:09.774458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3a420-9a05-4f3d-8dd5-4399bad8ddcc None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:09.774737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3a420-9a05-4f3d-8dd5-4399bad8ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:09.775038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3a420-9a05-4f3d-8dd5-4399bad8ddcc None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:09.775742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3a420-9a05-4f3d-8dd5-4399bad8ddcc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:09.777105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3a420-9a05-4f3d-8dd5-4399bad8ddcc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:09.792801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 590/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Sun Jul 31 18:26:09 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:26:11.798714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d3e0-56db-44a6-a285-23d9d92e1bb8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:11.799316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d3e0-56db-44a6-a285-23d9d92e1bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:11.799316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d3e0-56db-44a6-a285-23d9d92e1bb8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:11.800665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 580/1170] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:11.806398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d0d0-efa1-444d-a3ce-91bdfc898a5e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:11.806776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d0d0-efa1-444d-a3ce-91bdfc898a5e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:11.806970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d0d0-efa1-444d-a3ce-91bdfc898a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:11.824504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0e98d0d0-efa1-444d-a3ce-91bdfc898a5e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:11.825680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0e98d0d0-efa1-444d-a3ce-91bdfc898a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:11.890319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 591/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:11.913628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830d3e0-56db-44a6-a285-23d9d92e1bb8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:11.938690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:12.014973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830d3e0-56db-44a6-a285-23d9d92e1bb8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:12.047879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e51f0-0e18-4a95-9c85-6fc493e671ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:12.048537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e51f0-0e18-4a95-9c85-6fc493e671ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:12.048860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e51f0-0e18-4a95-9c85-6fc493e671ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:12.049077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e51f0-0e18-4a95-9c85-6fc493e671ff None admin] PATH_INFO: `/v3/domains/33659918f2a34e4a957256eaaf0c6d3c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:12.059420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e51f0-0e18-4a95-9c85-6fc493e671ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=33659918f2a34e4a957256eaaf0c6d3c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:12.060868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e51f0-0e18-4a95-9c85-6fc493e671ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:12.062444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 581/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Jul 31 18:26:11 2022] GET /identity/v3/domains/33659918f2a34e4a957256eaaf0c6d3c => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:26:12.068307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d0d0-efa1-444d-a3ce-91bdfc898a5e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:12.108630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:12.166210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d0d0-efa1-444d-a3ce-91bdfc898a5e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:12.200061 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaeeb5-872b-410d-b951-58108e7c321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:12.200695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaeeb5-872b-410d-b951-58108e7c321e None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:12.200971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaeeb5-872b-410d-b951-58108e7c321e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:12.201243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaeeb5-872b-410d-b951-58108e7c321e None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:12.201920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaeeb5-872b-410d-b951-58108e7c321e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:12.203374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaeeb5-872b-410d-b951-58108e7c321e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:12.229019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 592/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:26:12 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:26:14.294154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acdab8-0c25-4714-a772-f5d83ffe0404 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:14.294690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acdab8-0c25-4714-a772-f5d83ffe0404 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:14.294690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acdab8-0c25-4714-a772-f5d83ffe0404 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:14.296075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 582/1174] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:14.301755 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3285a1c-ba29-409b-bad6-f115261382cb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:14.302126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3285a1c-ba29-409b-bad6-f115261382cb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:14.302309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3285a1c-ba29-409b-bad6-f115261382cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:14.320945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d3285a1c-ba29-409b-bad6-f115261382cb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:14.322120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d3285a1c-ba29-409b-bad6-f115261382cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:14.386501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 593/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:14.411521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acdab8-0c25-4714-a772-f5d83ffe0404 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:14.495005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:14.511582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acdab8-0c25-4714-a772-f5d83ffe0404 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:14.543926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252026e-4a48-4a4e-9cd4-08749e5b7029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:14.544603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252026e-4a48-4a4e-9cd4-08749e5b7029 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:14.544837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252026e-4a48-4a4e-9cd4-08749e5b7029 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:14.545108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252026e-4a48-4a4e-9cd4-08749e5b7029 None admin] PATH_INFO: `/v3/domains/33659918f2a34e4a957256eaaf0c6d3c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:14.546235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252026e-4a48-4a4e-9cd4-08749e5b7029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=33659918f2a34e4a957256eaaf0c6d3c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:14.547684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252026e-4a48-4a4e-9cd4-08749e5b7029 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:14.549254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 583/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Jul 31 18:26:14 2022] GET /identity/v3/domains/33659918f2a34e4a957256eaaf0c6d3c => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:14.556153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3285a1c-ba29-409b-bad6-f115261382cb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:14.579100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:14.653962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3285a1c-ba29-409b-bad6-f115261382cb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:14.688355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bb1b3-beca-42c4-90a5-b299ced5fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:14.688962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb1b3-beca-42c4-90a5-b299ced5fa40 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:14.689239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb1b3-beca-42c4-90a5-b299ced5fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:14.689508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb1b3-beca-42c4-90a5-b299ced5fa40 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:14.690179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb1b3-beca-42c4-90a5-b299ced5fa40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:14.691629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb1b3-beca-42c4-90a5-b299ced5fa40 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:14.713244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 594/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:26:14 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:26:16.748908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1aa878-2bec-4577-8b93-97df9d76f595 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:16.749433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1aa878-2bec-4577-8b93-97df9d76f595 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:16.749433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1aa878-2bec-4577-8b93-97df9d76f595 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:16.750701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 584/1178] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:16.756509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f0fd-0476-4420-8c22-299639bdf671 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:16.756887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f0fd-0476-4420-8c22-299639bdf671 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:16.757067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f0fd-0476-4420-8c22-299639bdf671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:16.775696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-46e5f0fd-0476-4420-8c22-299639bdf671 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:16.776872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-46e5f0fd-0476-4420-8c22-299639bdf671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:16.840262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 595/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:16.864465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1aa878-2bec-4577-8b93-97df9d76f595 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:16.965585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1aa878-2bec-4577-8b93-97df9d76f595 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:16.997723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:16.998347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:16.998626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:16.998895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:17.009962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:26:17.015062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:26:17.016148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:26:17.017259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 585/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:26:17.023205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f0fd-0476-4420-8c22-299639bdf671 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:17.033050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:17.120119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f0fd-0476-4420-8c22-299639bdf671 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:17.152637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:17.153245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:17.153524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:17.153796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:17.154497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:17.154797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:17.156191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:17.163927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 596/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:17.169747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:17.185473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:17.268603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc7cd5-e2cf-475a-aa59-59bc2c4a8186 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:17.301654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:17.302279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:17.302624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:17.303446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] PATH_INFO: `/v3/users/7f415e97b9164f5faf81c35554b8739c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:17.315982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] RBAC: Authorizing `identity:get_user(user_id=7f415e97b9164f5faf81c35554b8739c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:17.317415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:17.319579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 586/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:26:17 2022] GET /identity/v3/users/7f415e97b9164f5faf81c35554b8739c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:17.325298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:17.391468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:17.422390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fcd6c-e390-4ff9-9666-4e0d8beac54e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:17.455427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:17.456051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:17.456330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:17.456602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:17.522094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:17.523689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:17.587789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:17.619015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 597/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:26:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:26:17.624890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:17.691795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:17.722010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e45cba-8987-4320-bf85-20a8a007dee2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:17.754520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f76dd4-2ad1-4a17-98b7-46d67296fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:17.755174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76dd4-2ad1-4a17-98b7-46d67296fee3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:17.755449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76dd4-2ad1-4a17-98b7-46d67296fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:17.755772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76dd4-2ad1-4a17-98b7-46d67296fee3 None admin] PATH_INFO: `/v3/projects/dd27200be8c74947b63d84529c6b092d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:17.756964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f76dd4-2ad1-4a17-98b7-46d67296fee3 None admin] RBAC: Authorizing `identity:get_project(project_id=dd27200be8c74947b63d84529c6b092d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:17.758377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f76dd4-2ad1-4a17-98b7-46d67296fee3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:17.760055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 587/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:26:17 2022] GET /identity/v3/projects/dd27200be8c74947b63d84529c6b092d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:17.766346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:17.862714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3099b2a-a849-48d7-bb7c-2d42660142f6 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:17.895773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0d687-ac4d-4f0d-b25f-259e10e77f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:17.897007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d687-ac4d-4f0d-b25f-259e10e77f95 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:17.897481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d687-ac4d-4f0d-b25f-259e10e77f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:17.897996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d687-ac4d-4f0d-b25f-259e10e77f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:17.898818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0d687-ac4d-4f0d-b25f-259e10e77f95 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=dd27200be8c74947b63d84529c6b092d, user.id=7f415e97b9164f5faf81c35554b8739c) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:17.899156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0d687-ac4d-4f0d-b25f-259e10e77f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:17.900570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0d687-ac4d-4f0d-b25f-259e10e77f95 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:17.905754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 598/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:26:17 2022] GET /identity/v3/role_assignments?user.id=7f415e97b9164f5faf81c35554b8739c&scope.project.id=dd27200be8c74947b63d84529c6b092d&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:19.851541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d305f-508e-4d3f-9000-ae94df5b9ed6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:19.852145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d305f-508e-4d3f-9000-ae94df5b9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:19.852145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d305f-508e-4d3f-9000-ae94df5b9ed6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:19.853459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 588/1186] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:19.858678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885ae9-21d9-40c7-9679-3902f809e7e3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:19.859111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885ae9-21d9-40c7-9679-3902f809e7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:19.859259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885ae9-21d9-40c7-9679-3902f809e7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:19.877496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-25885ae9-21d9-40c7-9679-3902f809e7e3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:19.878679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-25885ae9-21d9-40c7-9679-3902f809e7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:19.904726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:19.945543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 599/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:19.967910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d305f-508e-4d3f-9000-ae94df5b9ed6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:20.065570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d305f-508e-4d3f-9000-ae94df5b9ed6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:20.097667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:20.098377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:20.098652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:20.098919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:20.105899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:20.110150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:26:20.115955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:26:20.117238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:26:20.118403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 589/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:26:20.122970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25885ae9-21d9-40c7-9679-3902f809e7e3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:20.218026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25885ae9-21d9-40c7-9679-3902f809e7e3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:20.249882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:20.250486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:20.250763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:20.251064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:20.251763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:20.252060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:20.253445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:20.261804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 600/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:20.267645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:20.363510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1e30f-90e8-4627-ab3c-a71b72c6b184 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:20.395151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:20.395768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:20.396042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:20.396975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] PATH_INFO: `/v3/users/7f415e97b9164f5faf81c35554b8739c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:20.398112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7f415e97b9164f5faf81c35554b8739c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:20.399556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:20.401125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 590/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:26:20 2022] GET /identity/v3/users/7f415e97b9164f5faf81c35554b8739c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:20.406902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:20.434110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:20.510120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f409298-204a-4501-8018-d0a5d673f47f None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:20.542457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed54df-b470-4ec1-b406-bc6fd338cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:20.543120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed54df-b470-4ec1-b406-bc6fd338cd49 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:20.543398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed54df-b470-4ec1-b406-bc6fd338cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:20.543669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed54df-b470-4ec1-b406-bc6fd338cd49 None admin] PATH_INFO: `/v3/projects/dd27200be8c74947b63d84529c6b092d` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:20.544809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed54df-b470-4ec1-b406-bc6fd338cd49 None admin] RBAC: Authorizing `identity:get_project(project_id=dd27200be8c74947b63d84529c6b092d)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:20.546238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed54df-b470-4ec1-b406-bc6fd338cd49 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:20.547908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 601/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:26:20 2022] GET /identity/v3/projects/dd27200be8c74947b63d84529c6b092d => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:20.554242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:20.619593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:20.653305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563976f-e5d0-4b42-8859-fd547affc2b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:20.686584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53168f9-6cb1-4a07-8732-4db5dc3580c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:20.687265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53168f9-6cb1-4a07-8732-4db5dc3580c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:20.687546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53168f9-6cb1-4a07-8732-4db5dc3580c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:20.687817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53168f9-6cb1-4a07-8732-4db5dc3580c7 None admin] PATH_INFO: `/v3/projects/dd27200be8c74947b63d84529c6b092d/users/7f415e97b9164f5faf81c35554b8739c/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:20.689717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53168f9-6cb1-4a07-8732-4db5dc3580c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd27200be8c74947b63d84529c6b092d, user_id=7f415e97b9164f5faf81c35554b8739c, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:20.691168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53168f9-6cb1-4a07-8732-4db5dc3580c7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:20.704048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 591/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:26:20 2022] PUT /identity/v3/projects/dd27200be8c74947b63d84529c6b092d/users/7f415e97b9164f5faf81c35554b8739c/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:26:22.671782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3590073-7a36-4047-9213-f0eac8803ace None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:22.672335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3590073-7a36-4047-9213-f0eac8803ace None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:22.672335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3590073-7a36-4047-9213-f0eac8803ace None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:22.673695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 602/1193] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:26:22.678867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abd28a-0320-43bf-a9fb-e990725490a5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:22.679323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abd28a-0320-43bf-a9fb-e990725490a5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:22.679423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abd28a-0320-43bf-a9fb-e990725490a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:22.697451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c2abd28a-0320-43bf-a9fb-e990725490a5 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:26:22.698561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c2abd28a-0320-43bf-a9fb-e990725490a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:26:22.763213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 592/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:26:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:26:22.787095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3590073-7a36-4047-9213-f0eac8803ace None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:22.880109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:22.888595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3590073-7a36-4047-9213-f0eac8803ace None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:22.923007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:22.923640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:22.923923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:22.924190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:22.934439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:26:22.939276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:26:22.940378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:26:22.941280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 603/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:26:22.947693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abd28a-0320-43bf-a9fb-e990725490a5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:23.001621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:23.044644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abd28a-0320-43bf-a9fb-e990725490a5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:23.077256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:23.077872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:23.078152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:23.078428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:23.079161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:23.079468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:23.080852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:23.089484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 593/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:23.095256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:23.191711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86234e4-27bf-42c9-becf-c7056f6e49a0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:23.223763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:23.224906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:23.225180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:23.226071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] PATH_INFO: `/v3/users/7f415e97b9164f5faf81c35554b8739c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:23.226579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] RBAC: Authorizing `identity:get_user(user_id=7f415e97b9164f5faf81c35554b8739c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:23.228029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:23.229599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 604/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Jul 31 18:26:23 2022] GET /identity/v3/users/7f415e97b9164f5faf81c35554b8739c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:23.235358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:23.331547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999104f7-21f8-448b-b135-2ef90ddf1012 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:23.348084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:23.365330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:23.365942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:23.366223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:23.366495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:23.431247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:23.432707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:23.529794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 594/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:26:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:26:23.535713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:23.559329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:23.631593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f42a0-121b-4792-81c5-b86dc1273295 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:23.663939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f4541-e878-4502-bc03-af43a34b85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:23.664571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4541-e878-4502-bc03-af43a34b85bd None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:23.664848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4541-e878-4502-bc03-af43a34b85bd None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:23.665115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4541-e878-4502-bc03-af43a34b85bd None admin] PATH_INFO: `/v3/projects/dd27200be8c74947b63d84529c6b092d` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:23.666249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f4541-e878-4502-bc03-af43a34b85bd None admin] RBAC: Authorizing `identity:get_project(project_id=dd27200be8c74947b63d84529c6b092d)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:23.667700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f4541-e878-4502-bc03-af43a34b85bd None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:23.669339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 605/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Jul 31 18:26:23 2022] GET /identity/v3/projects/dd27200be8c74947b63d84529c6b092d => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:23.675341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:26:23.693763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:23.771717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dba77-0f6e-4156-b8b8-a0bde33119e7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:26:23.804470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b4e8-630a-4c24-a927-59bef2acce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:26:23.805014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b4e8-630a-4c24-a927-59bef2acce89 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:26:23.805294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b4e8-630a-4c24-a927-59bef2acce89 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:26:23.805567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b4e8-630a-4c24-a927-59bef2acce89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:26:23.806348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b4e8-630a-4c24-a927-59bef2acce89 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=dd27200be8c74947b63d84529c6b092d, user.id=7f415e97b9164f5faf81c35554b8739c) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:26:23.806658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b4e8-630a-4c24-a927-59bef2acce89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:26:23.808112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b4e8-630a-4c24-a927-59bef2acce89 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:26:23.813658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 595/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:26:23 2022] GET /identity/v3/role_assignments?user.id=7f415e97b9164f5faf81c35554b8739c&scope.project.id=dd27200be8c74947b63d84529c6b092d&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:26:33.659901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=55 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:26:33.811150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=59 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:18.925034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92959fc7-8c11-4daf-abeb-997f03980eb3 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:18.925645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92959fc7-8c11-4daf-abeb-997f03980eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:18.925645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92959fc7-8c11-4daf-abeb-997f03980eb3 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:18.926953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 606/1201] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:18.932520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4497da9-d62b-4d8b-bb94-1f13a4721f25 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:18.933100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4497da9-d62b-4d8b-bb94-1f13a4721f25 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:18.933100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4497da9-d62b-4d8b-bb94-1f13a4721f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:18.960486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d4497da9-d62b-4d8b-bb94-1f13a4721f25 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:18.961736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d4497da9-d62b-4d8b-bb94-1f13a4721f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:19.055151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 596/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:27:19.069915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92959fc7-8c11-4daf-abeb-997f03980eb3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:19.206290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92959fc7-8c11-4daf-abeb-997f03980eb3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:19.253247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:19.254340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:19.254824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:19.255189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:19.270142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:19.271686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:19.289464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:19.290851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:19.291929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:19.291929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:19.291929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:19.291929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:19.296194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 607/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:19.297802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4497da9-d62b-4d8b-bb94-1f13a4721f25 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:19.418527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4497da9-d62b-4d8b-bb94-1f13a4721f25 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:19.460768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:19.467044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b78599-c3f1-4d6d-a608-876eeca997f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:19.467696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78599-c3f1-4d6d-a608-876eeca997f1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:19.467996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78599-c3f1-4d6d-a608-876eeca997f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:19.468250 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78599-c3f1-4d6d-a608-876eeca997f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:19.468936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b78599-c3f1-4d6d-a608-876eeca997f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:19.469243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b78599-c3f1-4d6d-a608-876eeca997f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:19.470632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b78599-c3f1-4d6d-a608-876eeca997f1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:19.486987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 597/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:19.489532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:19.554385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:19.612280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a6ee-0c70-4ee8-8aa6-b28566b72a39 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:19.667170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaad04-1410-4863-9507-abbff4b83484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:19.667836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaad04-1410-4863-9507-abbff4b83484 None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:19.668097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaad04-1410-4863-9507-abbff4b83484 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:19.668394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaad04-1410-4863-9507-abbff4b83484 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:19.669114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaad04-1410-4863-9507-abbff4b83484 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:19.670521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaad04-1410-4863-9507-abbff4b83484 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:19.701598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 608/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Jul 31 18:27:19 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:27:22.132313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ff312-06e6-47c2-8acd-f2cb5268e4e7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:22.132906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ff312-06e6-47c2-8acd-f2cb5268e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:22.133009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ff312-06e6-47c2-8acd-f2cb5268e4e7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:22.134424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 598/1206] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:22.141693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea69ac8-66cc-4d72-b8fc-d349d6ad6273 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:22.142182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea69ac8-66cc-4d72-b8fc-d349d6ad6273 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:22.142281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea69ac8-66cc-4d72-b8fc-d349d6ad6273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:22.164648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cea69ac8-66cc-4d72-b8fc-d349d6ad6273 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:22.165866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cea69ac8-66cc-4d72-b8fc-d349d6ad6273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:22.256467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 609/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 18:27:22.280923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ff312-06e6-47c2-8acd-f2cb5268e4e7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:22.405170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ff312-06e6-47c2-8acd-f2cb5268e4e7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:22.447114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:22.447950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:22.448282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:22.448585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:22.461893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:27:22.466809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:22.471237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:22.472369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 599/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:27:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:22.475567 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea69ac8-66cc-4d72-b8fc-d349d6ad6273 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:22.528016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:22.597335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea69ac8-66cc-4d72-b8fc-d349d6ad6273 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:22.642730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:22.643979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:22.645166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:22.645166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:22.645363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:22.645528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:22.647031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:22.659470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 610/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:27:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:22.664246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:22.720416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:22.785824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10119-7b79-44ef-8e7d-8c337ff615e4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:22.824241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:22.824909 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:22.826297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:22.826297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:22.838717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:22.842527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:22.854866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:22.855969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:22.856907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:22.856907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:22.856907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:22.856907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:22.860816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 600/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:22.861927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:22.978076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:22.981708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2e3d1-24ee-4a0c-be7a-630b843ea5bb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:23.023448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:23.024078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:23.024357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:23.024635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:23.025382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:23.025689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:23.027434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:23.040814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 611/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:23.047112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:23.162350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e1dc-46f3-4797-9945-00860db47252 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:23.164048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:23.199432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:23.200080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:23.200357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:23.200627 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:23.208415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:23.210010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:27:23.221214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:23.224026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:23.225039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 601/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:23.228337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:23.345752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9407-a531-4986-9882-231437e59aff None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:23.384214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:23.384874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:23.385186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:23.385455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:23.386558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:23.386853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:23.388370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:23.406966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 612/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Jul 31 18:27:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:23.413317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:23.531344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea8fd-da1a-449d-8208-42ea99e0dace None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:23.573747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:23.574711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:23.575150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:23.575522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:23.609220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:23.653559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:23.655096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:23.762583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 602/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:27:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:27:23.763881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:23.796232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:23.890685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9e31b-d9cf-42c5-9f48-b9cfa2141657 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:23.930743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:23.931448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:23.931739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:23.932011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:23.943814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:23.945283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:23.962113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:23.963355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:23.964498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:23.964498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:23.964498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:23.964498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:23.968069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 613/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:23.969467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:24.045886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:24.086118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c252dd-0f75-498b-b169-afdade0ef760 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:24.124764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:24.125511 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:24.125892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:24.128580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:24.128580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:24.128580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:24.129459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:24.144488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 603/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:24.150905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:24.230454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:24.263778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577e1a0-aea2-4ab1-8dce-bfd929ec3583 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:24.304623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:24.305335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:24.305736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:24.306051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:24.314296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:24.316225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:27:24.328783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:24.329747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:24.330703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 614/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:24.336452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:24.454695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259802a-b0d1-498d-ab2d-26b91e06b76c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:24.484289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:24.499917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ab778-0caf-40d3-a4df-050a7851b04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:24.500537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ab778-0caf-40d3-a4df-050a7851b04b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:24.500818 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ab778-0caf-40d3-a4df-050a7851b04b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:24.501086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ab778-0caf-40d3-a4df-050a7851b04b None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:24.501820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ab778-0caf-40d3-a4df-050a7851b04b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:24.502121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ab778-0caf-40d3-a4df-050a7851b04b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:24.503736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ab778-0caf-40d3-a4df-050a7851b04b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:24.516151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 604/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:24.523054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:24.636144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281493-fda7-4ecd-ab18-11cf48e290b9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:24.666741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:24.672801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a3db-079d-41c6-8d82-95b142ca43da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:24.673476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a3db-079d-41c6-8d82-95b142ca43da None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:24.673746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a3db-079d-41c6-8d82-95b142ca43da None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:24.674054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a3db-079d-41c6-8d82-95b142ca43da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:24.675457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a3db-079d-41c6-8d82-95b142ca43da None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=4b07b5471c93462e90c45a195fdc376d) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:24.675776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a3db-079d-41c6-8d82-95b142ca43da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:24.677582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a3db-079d-41c6-8d82-95b142ca43da None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:24.690988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 615/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:27:24 2022] GET /identity/v3/role_assignments?user.id=4b07b5471c93462e90c45a195fdc376d&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:26.955783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c121d3c-9627-476e-9ab0-3a63cc859f24 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:26.956373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c121d3c-9627-476e-9ab0-3a63cc859f24 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:26.956373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c121d3c-9627-476e-9ab0-3a63cc859f24 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:26.957855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 605/1220] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:26.963776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db92-6035-423e-a572-695cf0238436 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:26.964258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db92-6035-423e-a572-695cf0238436 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:26.964362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2db92-6035-423e-a572-695cf0238436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:26.983861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-66d2db92-6035-423e-a572-695cf0238436 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:26.985051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-66d2db92-6035-423e-a572-695cf0238436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:27.057249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 616/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:27.081792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c121d3c-9627-476e-9ab0-3a63cc859f24 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:27.208093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c121d3c-9627-476e-9ab0-3a63cc859f24 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:27.241803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:27.242446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:27.242727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:27.243052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:27.254994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:27:27.261246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:27.262398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:27.263487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 606/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:27.269841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2db92-6035-423e-a572-695cf0238436 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:27.371153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2db92-6035-423e-a572-695cf0238436 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:27.395297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:27.406185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:27.406809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:27.407117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:27.407389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:27.408105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:27.408958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:27.410335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:27.418444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 617/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:27:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:27:27.424819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:27.473362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:27.533306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea3e90-363a-4fff-93e4-6838f8dbf74e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:27.572273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:27.572951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:27.573195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:27.573593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:27.584445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:27.585888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:27.600057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:27.601128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:27.602042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:27.602042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:27.602042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:27.602042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:27.602042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 607/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:27.607258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:27.712868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a2f81-17ec-4ad0-8c20-771c973d5d24 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:27.751004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:27.751728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:27.752011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:27.753037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:27.753888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:27.754267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:27.755680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:27.768122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 618/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:27.774700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:27.884060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:27.896801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da58c8a-b439-40bd-aa0b-011555d08cb5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:27.933363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:27.934103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:27.934400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:27.934747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:27.944047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:27.945559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:27:27.956796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:27.958289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:27.959301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 608/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:27:27.964151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:28.016320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:28.070504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e919b0-a5cd-411a-ac9e-90b9d6b34748 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:28.108669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:28.109337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:28.109636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:28.109927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:28.110807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:28.111135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:28.113362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:28.139618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 619/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Jul 31 18:27:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:28.140781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:28.265728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984cad-6731-4a85-b623-a782aa5efd7d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:28.308770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:28.309429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:28.309704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:28.310007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:28.322908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:28.324840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:28.348299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:28.349930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:28.351266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:28.351266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:28.351266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:28.351266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:28.351266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 609/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:28.356009 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:28.484189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7631a5-131d-40dc-a3ec-90cdff6d518e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:28.486730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:28.527245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:28.528004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:28.528319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:28.528590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:28.529308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:28.529762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:28.531813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:28.546771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 620/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:28.553358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:28.564227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:28.686573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929295d-988a-4a66-9ba9-00ee191ff849 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:28.735620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:28.736456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:28.737394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:28.737719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:28.745386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:28.746951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:27:28.762231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:28.763439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:28.764663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 610/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:28.770828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:28.912964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52574-69d9-4754-bacd-58b7ba0ea4ad None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:28.959040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479978c-4a22-4aa0-a9a5-57d7b93685c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:28.959883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479978c-4a22-4aa0-a9a5-57d7b93685c3 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:28.960202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479978c-4a22-4aa0-a9a5-57d7b93685c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:28.960586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479978c-4a22-4aa0-a9a5-57d7b93685c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:28.961507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479978c-4a22-4aa0-a9a5-57d7b93685c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:28.961853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479978c-4a22-4aa0-a9a5-57d7b93685c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:28.963510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479978c-4a22-4aa0-a9a5-57d7b93685c3 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:28.984164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 621/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:28.985506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:29.063015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:29.103908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee691-a46f-45dc-a538-4b7c695fd53d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:29.146551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae956a7-38cb-4efe-9b83-2c9ef651e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:29.147271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae956a7-38cb-4efe-9b83-2c9ef651e568 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:29.147571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae956a7-38cb-4efe-9b83-2c9ef651e568 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:29.147851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae956a7-38cb-4efe-9b83-2c9ef651e568 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/4b07b5471c93462e90c45a195fdc376d/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:29.166877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae956a7-38cb-4efe-9b83-2c9ef651e568 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=4b07b5471c93462e90c45a195fdc376d, role_id=04bcfbb7bd794ed2bc75b6228f5c4ae9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:29.168333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae956a7-38cb-4efe-9b83-2c9ef651e568 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:29.181840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 611/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:27:28 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/4b07b5471c93462e90c45a195fdc376d/roles/04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:27:31.319912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017a4e-3a90-41e5-9320-400c28cd95e0 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:31.320503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017a4e-3a90-41e5-9320-400c28cd95e0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:31.320503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017a4e-3a90-41e5-9320-400c28cd95e0 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:31.322460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 622/1233] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:31.328509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28f1e5-2506-4489-96b7-0ccedef155d2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:31.328931 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28f1e5-2506-4489-96b7-0ccedef155d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:31.329060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28f1e5-2506-4489-96b7-0ccedef155d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:31.347960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dd28f1e5-2506-4489-96b7-0ccedef155d2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:31.349158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dd28f1e5-2506-4489-96b7-0ccedef155d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:31.418379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 612/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:31.443805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8017a4e-3a90-41e5-9320-400c28cd95e0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:31.469368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:31.550945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8017a4e-3a90-41e5-9320-400c28cd95e0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:31.585969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:31.586532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:31.586809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:31.587115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:31.597921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:27:31.602816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:31.603992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:31.604923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 623/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Jul 31 18:27:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:31.610166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28f1e5-2506-4489-96b7-0ccedef155d2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:31.658878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:31.721982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28f1e5-2506-4489-96b7-0ccedef155d2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:31.759294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:31.759925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:31.760205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:31.760726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:31.761450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:31.761753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:31.763158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:31.771927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 613/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Jul 31 18:27:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:31.778475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:31.868977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:31.889957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9a88-89ea-457e-b726-d957cfd42eeb None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:31.926720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:31.927398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:31.927676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:31.927965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:31.938178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:31.939745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:31.955463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:31.956524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:31.957446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:31.957446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:31.957446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:31.957446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:31.957446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 624/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:31.963084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:32.075964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b797402-b3c5-46f4-8e9d-70ffdf49c512 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:32.086080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:32.116925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:32.117831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:32.118255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:32.118632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:32.119749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:32.120024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:32.121941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:32.138622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 614/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:32.145123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:32.263324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b443f-5d86-46b1-bf8f-aa4e12bb49e0 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:32.299293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:32.299991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:32.300323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:32.300650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:32.303852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:32.310252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:32.312391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:27:32.324335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:32.325879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:32.326830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 625/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:32.332444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:32.456179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77f5f-2e73-4616-8a5d-2d21b12a5df1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:32.496396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:32.497053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:32.497457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:32.497620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:32.498531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:32.498921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:32.500580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:32.520932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 615/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Jul 31 18:27:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:32.526956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:32.639876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc7212-66c3-4987-8ff6-03166594efdc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:32.675482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:32.676260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:32.676556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:32.676809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:32.738132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:32.745087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:32.746547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:32.850278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 626/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:27:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:27:32.856074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:32.887612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:32.973648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca26c6-72c0-46e0-a8c1-ea91abb9c1ea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:33.017805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:33.018492 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:33.018775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:33.019106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:33.030596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:33.032230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:33.047384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:33.049301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:33.050411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:33.050411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:33.050411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:33.050411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:33.050411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 616/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:33.055208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:33.161584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:33.170601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82e2d7-d27b-44c6-9f30-dc4b9f5a7c85 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:33.206510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:33.207172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:33.207447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:33.207717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:33.208409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:33.208750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:33.210137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:33.223553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 627/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:27:33.229512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:33.318260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:33.343426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93a97-0617-48c3-ba6e-dee9298473f2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:33.384103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:33.384883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:33.385163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:33.385679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:33.393314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:33.394996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:27:33.407458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:33.408651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:33.409767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 617/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:33.414743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:33.529629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ea64f-dd85-4db2-8fbb-5793fb1bf3ee None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:33.566868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cb848-14a5-412f-b9f6-b9a0122d0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:33.567733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cb848-14a5-412f-b9f6-b9a0122d0d11 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:33.568108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cb848-14a5-412f-b9f6-b9a0122d0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:33.568585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cb848-14a5-412f-b9f6-b9a0122d0d11 None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:33.569228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cb848-14a5-412f-b9f6-b9a0122d0d11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:33.569527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cb848-14a5-412f-b9f6-b9a0122d0d11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:33.571111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cb848-14a5-412f-b9f6-b9a0122d0d11 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:33.585356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 628/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:27:33.591983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:33.698505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae810e-7a82-483b-a806-a30d52702273 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:33.732888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8f856-ed47-4ca7-9985-e044ca14a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:33.733504 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f856-ed47-4ca7-9985-e044ca14a740 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:33.733782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f856-ed47-4ca7-9985-e044ca14a740 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:33.734051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f856-ed47-4ca7-9985-e044ca14a740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:33.734827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f856-ed47-4ca7-9985-e044ca14a740 None admin] RBAC: Adding query filter params (role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=4b07b5471c93462e90c45a195fdc376d) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:33.735172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f856-ed47-4ca7-9985-e044ca14a740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:33.738336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f856-ed47-4ca7-9985-e044ca14a740 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:33.744312 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 618/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:27:33 2022] GET /identity/v3/role_assignments?user.id=4b07b5471c93462e90c45a195fdc376d&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=04bcfbb7bd794ed2bc75b6228f5c4ae9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:36.135620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e6abb-655f-46a0-a280-82620bf201cb None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:36.136221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e6abb-655f-46a0-a280-82620bf201cb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:36.136221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e6abb-655f-46a0-a280-82620bf201cb None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:36.137892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 629/1247] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:36.143902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc0be-afad-4737-95b0-bffbac4511c1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:36.144471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc0be-afad-4737-95b0-bffbac4511c1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:36.144614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc0be-afad-4737-95b0-bffbac4511c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:36.152313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:36.168507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-28adc0be-afad-4737-95b0-bffbac4511c1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:36.169881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28adc0be-afad-4737-95b0-bffbac4511c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:36.248274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 619/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:36.275329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e6abb-655f-46a0-a280-82620bf201cb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:36.296834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:36.389452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e6abb-655f-46a0-a280-82620bf201cb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:36.432199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:36.432855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:36.433156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:36.433417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:36.445103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:27:36.450764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:36.452112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:27:36.453164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:36.460779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 630/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:27:36.460923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc0be-afad-4737-95b0-bffbac4511c1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:36.573618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc0be-afad-4737-95b0-bffbac4511c1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:36.610385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:36.617423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:36.618592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:36.619169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:36.619450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:36.620287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:36.620599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:36.622131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:36.632536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 620/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:36.638624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:36.733697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:36.767180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd97ef3-3ff1-4730-b56e-7af1f1af449a None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:36.810327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:36.811021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:36.811305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:36.811594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:36.823353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:36.824836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:36.841366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:36.842561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:36.843942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:36.843942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:36.843942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:36.843942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:36.843942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 631/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:27:36.848712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:36.969499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee1a3-f3b5-473a-8fb6-a7de5faa9ebb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:37.010022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:37.011039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:37.011327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:37.011605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:37.012345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:37.012708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:37.014158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:37.028356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 621/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:37.033895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:37.143692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805682bd-5fc8-4678-a4cf-720b79a02d79 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:37.173050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:37.182423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:37.183239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:37.183593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:37.183996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:37.192893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:37.195470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:27:37.208561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:37.209629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:37.211257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 632/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:27:37.215718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:37.290370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:37.343585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddf43e-ee20-4991-bdfd-68b5ae32341d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:37.382563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:37.383237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:37.383499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:37.383764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:37.384620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:37.384995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:37.387282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:37.408523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 622/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Jul 31 18:27:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:37.414789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:37.540644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd7a2-9151-48fe-9207-19fa7efd5ffc None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:37.576640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:37.577275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:37.577591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:37.577874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:37.637924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:37.650921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:37.652490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:37.768047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 633/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:27:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:27:37.774204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:37.880974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b936a-003a-4624-a3b3-671dc33d620f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:37.896284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:37.918901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:37.919574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:37.919859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:37.920159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:37.930638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:37.932144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:37.947429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:37.948414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:37.949391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:37.949391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:37.949391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:37.949391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:37.949391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 623/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:37.954469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:38.044641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:38.057696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb05b-8c9b-405d-b079-feb7f8afd52b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:38.099837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:38.100467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:38.100729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:38.101001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:38.101687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:38.101993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:38.103405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:38.116458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 634/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:38.122774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:38.236261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f0a4-2b27-4c53-a9ad-d95a532ce5e6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:38.273850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:38.274513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:38.274770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:38.275122 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:38.283445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:38.291581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:27:38.303055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:38.304249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:38.305385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 624/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:38.310470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:38.418241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14de344-bd2d-41e2-b5d7-8205bf17e964 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:38.456799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1b877-8167-46aa-bec0-809ea67db55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:38.457419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1b877-8167-46aa-bec0-809ea67db55b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:38.457697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1b877-8167-46aa-bec0-809ea67db55b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:38.457965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1b877-8167-46aa-bec0-809ea67db55b None admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:38.458696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1b877-8167-46aa-bec0-809ea67db55b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:38.459026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1b877-8167-46aa-bec0-809ea67db55b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:38.460434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1b877-8167-46aa-bec0-809ea67db55b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:38.472620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 635/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:27:38.478855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:38.507146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:38.589721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962997b-4432-46a0-9d39-c61ac4557177 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:38.627334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe26e0-baf7-4703-83d8-e393fcd1c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:38.627971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe26e0-baf7-4703-83d8-e393fcd1c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:38.628254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe26e0-baf7-4703-83d8-e393fcd1c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:38.628528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe26e0-baf7-4703-83d8-e393fcd1c1a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:38.629318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe26e0-baf7-4703-83d8-e393fcd1c1a2 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=4b07b5471c93462e90c45a195fdc376d) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:38.629634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe26e0-baf7-4703-83d8-e393fcd1c1a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:38.631117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe26e0-baf7-4703-83d8-e393fcd1c1a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:38.636995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 625/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:27:38 2022] GET /identity/v3/role_assignments?user.id=4b07b5471c93462e90c45a195fdc376d&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=2f18a54954a047398aca6b1a7389586b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:40.686212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562c61e-4b56-46a2-a73b-fd9977567bd1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:40.686730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562c61e-4b56-46a2-a73b-fd9977567bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:40.686730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562c61e-4b56-46a2-a73b-fd9977567bd1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:40.688042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 636/1261] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:40.693606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a69cb-5323-4b33-80f0-3f9b24eb7720 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:40.694049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a69cb-5323-4b33-80f0-3f9b24eb7720 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:40.694159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a69cb-5323-4b33-80f0-3f9b24eb7720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:40.712092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0d2a69cb-5323-4b33-80f0-3f9b24eb7720 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:40.713265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0d2a69cb-5323-4b33-80f0-3f9b24eb7720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:40.778484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 626/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:40.801657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562c61e-4b56-46a2-a73b-fd9977567bd1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:40.812177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:40.898686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562c61e-4b56-46a2-a73b-fd9977567bd1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:40.931386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:40.932010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:40.932284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:40.932552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:40.942285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:27:40.947015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:40.948142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:40.949221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 637/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:40.954163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a69cb-5323-4b33-80f0-3f9b24eb7720 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:40.972605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:41.052516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a69cb-5323-4b33-80f0-3f9b24eb7720 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:41.085095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:41.085706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:41.085987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:41.086277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:41.086988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:41.087297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:41.088669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:41.096961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 627/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:41.102561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:41.174689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:41.207853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf49334-2d2a-4531-aed5-800f6091cb4e None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:41.239699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:41.240339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:41.240620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:41.240894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:41.251132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:41.252874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:41.266763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:41.268394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:41.269656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:41.269656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:41.269656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:41.269656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:41.269656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 638/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:41.274292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:41.354076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:41.372889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383b60f-8aaf-4b6f-aa30-d1a2f316f360 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:41.404847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:41.405452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:41.405728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:41.405995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:41.406666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:41.406990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:41.408985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:41.420108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 628/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:41.425813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:41.522761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6741e-1a84-4b7b-be38-4b1032402b89 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:41.541376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:41.554898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:41.555558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:41.555838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:41.556109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:41.563298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:41.565289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:27:41.576169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:41.577282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:41.578617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 639/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:41.583300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:41.690358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6880ad-8186-4f89-92ac-012c04ad901e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:41.723516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:41.724127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:41.724405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:41.724676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:41.725460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:41.725764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:41.727215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:41.735476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:41.744903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 629/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Jul 31 18:27:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:41.750489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:41.853415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272bda7-13f7-4a84-a34d-e5fc7b8fe419 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:41.887796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:41.888710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:41.888992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:41.889262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:41.899509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:41.900940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:41.914544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:41.915671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:41.916802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:41.916802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:41.916802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:41.916802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:41.916802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 640/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:41.921316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:42.018747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991191b-2d40-41a9-8587-136b3f8b3039 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:42.051760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576746e-9db6-4635-8920-44763943e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:42.052376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576746e-9db6-4635-8920-44763943e890 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:42.052655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576746e-9db6-4635-8920-44763943e890 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:42.052925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576746e-9db6-4635-8920-44763943e890 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:42.053606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576746e-9db6-4635-8920-44763943e890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:42.053908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576746e-9db6-4635-8920-44763943e890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:42.055306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576746e-9db6-4635-8920-44763943e890 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:42.066861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 630/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:42.072383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:42.102620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:42.177142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10dba-3335-412c-a2bc-a9ccdf17f77d None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:42.209329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:42.209964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:42.210243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:42.210516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:42.217052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:42.218498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:27:42.230349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:42.231453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:42.232587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 641/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 18:27:42.237530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576746e-9db6-4635-8920-44763943e890 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:42.294751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:42.337665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576746e-9db6-4635-8920-44763943e890 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:42.369943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9df60-307c-41ea-95af-db1e5a02be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:42.370551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9df60-307c-41ea-95af-db1e5a02be07 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:42.370830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9df60-307c-41ea-95af-db1e5a02be07 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:42.371136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9df60-307c-41ea-95af-db1e5a02be07 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:42.371902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9df60-307c-41ea-95af-db1e5a02be07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:42.372205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9df60-307c-41ea-95af-db1e5a02be07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:42.373622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9df60-307c-41ea-95af-db1e5a02be07 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:42.386346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 631/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:42.392911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:42.481109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:42.489885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e2363-2d4e-4739-a8dc-27097049dc64 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:42.522488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9927ad-ff4b-4e15-8df7-50f90cfb1362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:42.523163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9927ad-ff4b-4e15-8df7-50f90cfb1362 None admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:42.523441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9927ad-ff4b-4e15-8df7-50f90cfb1362 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:42.523711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9927ad-ff4b-4e15-8df7-50f90cfb1362 None admin] PATH_INFO: `/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/4b07b5471c93462e90c45a195fdc376d/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:42.525592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9927ad-ff4b-4e15-8df7-50f90cfb1362 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user_id=4b07b5471c93462e90c45a195fdc376d, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:42.527046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9927ad-ff4b-4e15-8df7-50f90cfb1362 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:42.539260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 642/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Jul 31 18:27:42 2022] PUT /identity/v3/projects/e8bbd0dc8c1a4d66ba70cf3e5f6be901/users/4b07b5471c93462e90c45a195fdc376d/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:27:44.494027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3663-a1e9-4995-bb6a-b1d3d9408720 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:44.494573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3663-a1e9-4995-bb6a-b1d3d9408720 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:44.494573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3663-a1e9-4995-bb6a-b1d3d9408720 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:44.495973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 632/1274] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:44.501729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fa2b5-c2b1-4819-8c4b-c682bb9b7641 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:44.502227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fa2b5-c2b1-4819-8c4b-c682bb9b7641 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:44.502338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fa2b5-c2b1-4819-8c4b-c682bb9b7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:44.520918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-841fa2b5-c2b1-4819-8c4b-c682bb9b7641 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:44.522094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-841fa2b5-c2b1-4819-8c4b-c682bb9b7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:44.586314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 643/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:44.608859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3663-a1e9-4995-bb6a-b1d3d9408720 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:44.707446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3663-a1e9-4995-bb6a-b1d3d9408720 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:44.724288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:44.741501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:44.742126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:44.742402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:44.742672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:44.752684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 18:27:44.757458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:44.758581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:44.759695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 633/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Jul 31 18:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:44.764876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fa2b5-c2b1-4819-8c4b-c682bb9b7641 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:44.842604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:44.861861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fa2b5-c2b1-4819-8c4b-c682bb9b7641 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:44.894775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:44.895408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:44.895689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:44.895968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:44.896670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:44.896970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:44.898338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:44.906031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 644/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Jul 31 18:27:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:44.912210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:45.009577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60f920-a0d8-4150-9052-0e9389cfd4de None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:45.044634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:45.045261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:45.045546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:45.045814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:45.055458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:45.056900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:45.071116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:45.072226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:45.073564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:45.073564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:45.073564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:45.073564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:45.073564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 634/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:45.077989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:45.181229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5e6e2-41be-4c84-b32e-a32979b4deed None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:45.213635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:45.214246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:45.214523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:45.214795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:45.215502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:45.215805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:45.217169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:45.229005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 645/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:45.234631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:45.265511 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:45.333615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7016f75-ab8f-4e6f-a61a-e8045c2e3196 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:45.365714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:45.366343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:45.366621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:45.366887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:45.374040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:45.375495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 18:27:45.387400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:45.388576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:45.389734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 635/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:45.395219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:45.398908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:45.492130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963d57-db8e-4e71-b0ca-fb1cb84c61a9 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:45.525491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:45.526042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:45.526301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:45.526572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:45.527381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:45.527686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:45.529101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:45.545322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 646/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Jul 31 18:27:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:45.551315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:45.643078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:45.652905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651426b-a5d4-401b-8846-8550ac2c29cf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:45.685048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:45.685654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:45.685934 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:45.686207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:45.750789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:45.753034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:45.837307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:45.848130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 636/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Jul 31 18:27:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 18:27:45.853899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:45.914899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:45.953163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cf59-a735-4021-88c1-8518f0b38b57 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:45.985852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:45.986484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:45.986758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:45.987059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:45.996677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:45.998108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 18:27:46.012482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:46.013547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:46.014827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 18:27:46.014827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 18:27:46.014827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 18:27:46.014827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:46.014827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 647/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:46.019426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:46.115091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459e79-c09f-48db-91d9-165e9f47ccbc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:46.149584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:46.150201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:46.150483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:46.150758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:46.151474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:46.151781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:46.153149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:46.164606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 637/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Jul 31 18:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:46.170277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:46.266386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d585-4805-4582-8718-4ecc6e12e4e5 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:46.279757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:46.300712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:46.301341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:46.301622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:46.301895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:46.308379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:46.309821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 18:27:46.320972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:46.322037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: ERROR keystone.server.flask.application Jul 31 18:27:46.323183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 648/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Jul 31 18:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:46.327856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:46.377918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:46.427276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c49c2b-5250-4fa0-a0e7-9d391bc3ac60 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:46.459907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9945a2-4eeb-4763-b1a9-0be07eaaa9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:46.460521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9945a2-4eeb-4763-b1a9-0be07eaaa9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:46.460801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9945a2-4eeb-4763-b1a9-0be07eaaa9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:46.461072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9945a2-4eeb-4763-b1a9-0be07eaaa9e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:46.461808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9945a2-4eeb-4763-b1a9-0be07eaaa9e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:46.462112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9945a2-4eeb-4763-b1a9-0be07eaaa9e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:46.463580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9945a2-4eeb-4763-b1a9-0be07eaaa9e1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:46.475692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 638/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Jul 31 18:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:46.481721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:46.578013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba2cc-e09c-483f-bc18-ca017aeac90b None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:46.610953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5be39b-feee-48c3-8406-72db99b11e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:46.611565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be39b-feee-48c3-8406-72db99b11e70 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:46.611841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be39b-feee-48c3-8406-72db99b11e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:46.612113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be39b-feee-48c3-8406-72db99b11e70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:46.612889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be39b-feee-48c3-8406-72db99b11e70 None admin] RBAC: Adding query filter params (role.id=2f18a54954a047398aca6b1a7389586b, scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901, user.id=4b07b5471c93462e90c45a195fdc376d) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:46.613198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be39b-feee-48c3-8406-72db99b11e70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:46.614625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be39b-feee-48c3-8406-72db99b11e70 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:46.620262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 649/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Jul 31 18:27:46 2022] GET /identity/v3/role_assignments?user.id=4b07b5471c93462e90c45a195fdc376d&scope.project.id=e8bbd0dc8c1a4d66ba70cf3e5f6be901&role.id=2f18a54954a047398aca6b1a7389586b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:48.643116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c596-4dda-4b12-9015-5dba5cee5c3c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:48.643640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c596-4dda-4b12-9015-5dba5cee5c3c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:48.643640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c596-4dda-4b12-9015-5dba5cee5c3c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:48.645000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 639/1288] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:48.649967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2f51-517c-4e4b-80c4-494020c4c4c2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:48.650347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2f51-517c-4e4b-80c4-494020c4c4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:48.650521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2f51-517c-4e4b-80c4-494020c4c4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:48.668660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ca7b2f51-517c-4e4b-80c4-494020c4c4c2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:48.669832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ca7b2f51-517c-4e4b-80c4-494020c4c4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:48.699492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:48.735809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 650/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:48.757544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c596-4dda-4b12-9015-5dba5cee5c3c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:48.854158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c596-4dda-4b12-9015-5dba5cee5c3c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:48.864906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:48.888700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:48.889325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:48.889601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:48.889869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:48.890478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:48.891918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:48.900423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:48.901640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:48.902770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 640/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:27:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:48.907966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2f51-517c-4e4b-80c4-494020c4c4c2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:49.005928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2f51-517c-4e4b-80c4-494020c4c4c2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:49.040207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c83bf-df13-4633-a511-d84da66364f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:49.040816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c83bf-df13-4633-a511-d84da66364f9 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:49.041093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c83bf-df13-4633-a511-d84da66364f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:49.041365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c83bf-df13-4633-a511-d84da66364f9 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:49.042030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c83bf-df13-4633-a511-d84da66364f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:49.042332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c83bf-df13-4633-a511-d84da66364f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:49.045442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c83bf-df13-4633-a511-d84da66364f9 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:49.051249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 651/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Jul 31 18:27:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:49.056980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:49.161093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435f460-7728-4e1e-99dc-697eb4da06f6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:49.200844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27262737-6f6f-4dfa-ae62-f32190f9c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:49.201494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262737-6f6f-4dfa-ae62-f32190f9c622 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:49.201808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262737-6f6f-4dfa-ae62-f32190f9c622 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:49.202178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262737-6f6f-4dfa-ae62-f32190f9c622 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:49.203068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27262737-6f6f-4dfa-ae62-f32190f9c622 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:49.203486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27262737-6f6f-4dfa-ae62-f32190f9c622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:49.205469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27262737-6f6f-4dfa-ae62-f32190f9c622 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:49.210679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 641/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Jul 31 18:27:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:51.169309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eab56-89c4-4ed2-a108-cfd51b4bd185 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:51.169934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eab56-89c4-4ed2-a108-cfd51b4bd185 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:51.169934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eab56-89c4-4ed2-a108-cfd51b4bd185 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:51.171247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 652/1293] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:51.176897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fcfc9-d822-4468-acf5-4ccdbef6e304 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:51.177295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fcfc9-d822-4468-acf5-4ccdbef6e304 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:51.177562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fcfc9-d822-4468-acf5-4ccdbef6e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:51.195926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c89fcfc9-d822-4468-acf5-4ccdbef6e304 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:51.197105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c89fcfc9-d822-4468-acf5-4ccdbef6e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:51.225886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:51.262721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 642/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:51.285286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eab56-89c4-4ed2-a108-cfd51b4bd185 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:51.315874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:51.385473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eab56-89c4-4ed2-a108-cfd51b4bd185 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:51.418037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e779af1-b810-47ad-bc97-e1277368963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:51.418648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779af1-b810-47ad-bc97-e1277368963d None admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:51.418948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779af1-b810-47ad-bc97-e1277368963d None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:51.419230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779af1-b810-47ad-bc97-e1277368963d None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:51.419970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779af1-b810-47ad-bc97-e1277368963d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:51.421283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779af1-b810-47ad-bc97-e1277368963d None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:51.435770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 653/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Jul 31 18:27:51 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:27:53.412620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2351f-6d3e-4fc2-9077-8080091833f2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:53.413170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2351f-6d3e-4fc2-9077-8080091833f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:53.413170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2351f-6d3e-4fc2-9077-8080091833f2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:53.414523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 643/1296] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:53.419461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632a9f-ea96-4117-ab49-d9a7104eeb09 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:53.419864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632a9f-ea96-4117-ab49-d9a7104eeb09 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:53.420009 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632a9f-ea96-4117-ab49-d9a7104eeb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:53.437558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-97632a9f-ea96-4117-ab49-d9a7104eeb09 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:53.438756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-97632a9f-ea96-4117-ab49-d9a7104eeb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:53.508732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 654/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:53.531426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2351f-6d3e-4fc2-9077-8080091833f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:53.631117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2351f-6d3e-4fc2-9077-8080091833f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:53.664038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:53.664601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:53.664877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:53.665146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:53.665751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:53.667138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:53.676087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:53.677374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:53.678310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 644/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:27:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:53.683131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97632a9f-ea96-4117-ab49-d9a7104eeb09 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:53.701432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:53.780931 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97632a9f-ea96-4117-ab49-d9a7104eeb09 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:53.813519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:53.814115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:53.814390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:53.814657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:53.815345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:53.815640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:53.816993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:53.821888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 655/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Jul 31 18:27:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:53.827759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:53.859113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:53.930895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bb3fe-766e-4a7b-8959-f3730462c3be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:53.963443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7e573-b935-4242-a7f9-56b9b9ae05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:53.964054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e573-b935-4242-a7f9-56b9b9ae05b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:53.964336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e573-b935-4242-a7f9-56b9b9ae05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:53.964608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e573-b935-4242-a7f9-56b9b9ae05b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:53.965352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7e573-b935-4242-a7f9-56b9b9ae05b3 None admin] RBAC: Adding query filter params (interface=public, service_id=0cf1e4f793394d9997cbceb8a25caeeb, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:53.965662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7e573-b935-4242-a7f9-56b9b9ae05b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:53.967058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7e573-b935-4242-a7f9-56b9b9ae05b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:53.972610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 645/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Jul 31 18:27:53 2022] GET /identity/v3/endpoints?service_id=0cf1e4f793394d9997cbceb8a25caeeb&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:27:53.978318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:54.055743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:54.073787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30579068-b9c3-4bcd-81f4-952faa0470f4 None admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:54.105369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f394b-eb06-49df-b518-ca578e7dacde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:54.105968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f394b-eb06-49df-b518-ca578e7dacde None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:54.106243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f394b-eb06-49df-b518-ca578e7dacde None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:54.106512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f394b-eb06-49df-b518-ca578e7dacde None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:54.107176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f394b-eb06-49df-b518-ca578e7dacde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:54.108536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f394b-eb06-49df-b518-ca578e7dacde None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:54.115808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 656/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Jul 31 18:27:53 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:27:56.102778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a79bea-ef42-4afb-bded-4173ccd1ac87 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:56.103351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a79bea-ef42-4afb-bded-4173ccd1ac87 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:56.103351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a79bea-ef42-4afb-bded-4173ccd1ac87 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:56.104702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 646/1302] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:27:56.110359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690cc7f-79e3-4152-a345-181dea91921f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:56.110760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690cc7f-79e3-4152-a345-181dea91921f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:56.110910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690cc7f-79e3-4152-a345-181dea91921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:56.130177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c690cc7f-79e3-4152-a345-181dea91921f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:27:56.131555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c690cc7f-79e3-4152-a345-181dea91921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:27:56.202805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 657/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:27:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 18:27:56.225595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a79bea-ef42-4afb-bded-4173ccd1ac87 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:56.317921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:56.324698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a79bea-ef42-4afb-bded-4173ccd1ac87 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:56.356951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:56.357514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:56.357789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:56.358057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:56.358667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:56.360609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 18:27:56.369079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 18:27:56.370364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 31 18:27:56.371277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 647/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Jul 31 18:27:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 18:27:56.377012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690cc7f-79e3-4152-a345-181dea91921f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:56.450757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:27:56.473643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690cc7f-79e3-4152-a345-181dea91921f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:56.505935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eff56-d6ef-43a1-8b1f-97d7cf4ba9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:56.506545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eff56-d6ef-43a1-8b1f-97d7cf4ba9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:56.506821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eff56-d6ef-43a1-8b1f-97d7cf4ba9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:56.507123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eff56-d6ef-43a1-8b1f-97d7cf4ba9f8 None admin] PATH_INFO: `/v3/services` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:56.507786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eff56-d6ef-43a1-8b1f-97d7cf4ba9f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:27:56.508085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eff56-d6ef-43a1-8b1f-97d7cf4ba9f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:56.509446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eff56-d6ef-43a1-8b1f-97d7cf4ba9f8 None admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:56.514634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 658/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Jul 31 18:27:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:27:56.520576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:27:56.616092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9eb14-2db9-475d-a42f-02943dff260d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:27:56.647956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de75d5c-5a58-46c5-a75c-0686abd0394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:27:56.648549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75d5c-5a58-46c5-a75c-0686abd0394a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:27:56.648826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75d5c-5a58-46c5-a75c-0686abd0394a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:27:56.649096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75d5c-5a58-46c5-a75c-0686abd0394a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:27:56.649780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de75d5c-5a58-46c5-a75c-0686abd0394a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:27:56.651189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de75d5c-5a58-46c5-a75c-0686abd0394a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:27:56.672454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 648/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:27:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:28:06.511696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=30 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:28:06.668131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:28:59.380947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffae6a-5d26-4d5a-aeb4-e7387092e83c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:28:59.382090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffae6a-5d26-4d5a-aeb4-e7387092e83c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:28:59.382599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffae6a-5d26-4d5a-aeb4-e7387092e83c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:28:59.384548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 659/1307] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:28:59.390384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017340-b4a1-4669-ac23-5cb4d2680b57 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:28:59.390831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017340-b4a1-4669-ac23-5cb4d2680b57 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:28:59.390915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017340-b4a1-4669-ac23-5cb4d2680b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:28:59.475213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-69017340-b4a1-4669-ac23-5cb4d2680b57 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:28:59.476829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-69017340-b4a1-4669-ac23-5cb4d2680b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:28:59.624241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 649/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:28:59.663539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd3d21-f126-4ca2-8e0d-e437f9a5ce40 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:28:59.663792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd3d21-f126-4ca2-8e0d-e437f9a5ce40 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:28:59.664092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd3d21-f126-4ca2-8e0d-e437f9a5ce40 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:28:59.665346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 660/1309] 10.222.0.20 () {54 vars in 965 bytes} [Sun Jul 31 18:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:28:59.687855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174f17d-0ffb-4792-9c7c-dc58a7678f9a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:28:59.689137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174f17d-0ffb-4792-9c7c-dc58a7678f9a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:28:59.690552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174f17d-0ffb-4792-9c7c-dc58a7678f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:28:59.849835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9174f17d-0ffb-4792-9c7c-dc58a7678f9a None None] MFA Rules not processed for user `235416b3ebfc42f48be079760f271fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:28:59.851720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9174f17d-0ffb-4792-9c7c-dc58a7678f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:28:59.891532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:28:59.958047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 650/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Jul 31 18:28:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:28:59.969040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd3d21-f126-4ca2-8e0d-e437f9a5ce40 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:28:59.970815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d6cd3d21-f126-4ca2-8e0d-e437f9a5ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:00.107650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd3d21-f126-4ca2-8e0d-e437f9a5ce40 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:00.195153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944532-af80-4d40-ac8e-8fa4115bbe7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:00.195737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944532-af80-4d40-ac8e-8fa4115bbe7a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:00.196019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944532-af80-4d40-ac8e-8fa4115bbe7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:00.196290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944532-af80-4d40-ac8e-8fa4115bbe7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:00.197912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ff944532-af80-4d40-ac8e-8fa4115bbe7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:00.255321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:00.318229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff944532-af80-4d40-ac8e-8fa4115bbe7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:00.319705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff944532-af80-4d40-ac8e-8fa4115bbe7a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:00.339381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 661/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:02.707938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983566e6-3316-43e2-b206-a64e8d7a7a74 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:02.708407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983566e6-3316-43e2-b206-a64e8d7a7a74 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:02.708489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983566e6-3316-43e2-b206-a64e8d7a7a74 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:02.709879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 651/1312] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:02.716099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722afc8-8f13-488e-973c-41e327c8acc2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:02.716595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722afc8-8f13-488e-973c-41e327c8acc2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:02.716680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722afc8-8f13-488e-973c-41e327c8acc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:02.807485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7722afc8-8f13-488e-973c-41e327c8acc2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:02.809336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7722afc8-8f13-488e-973c-41e327c8acc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:02.923338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 662/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:29:02.962788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983566e6-3316-43e2-b206-a64e8d7a7a74 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:02.965133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-983566e6-3316-43e2-b206-a64e8d7a7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:03.078247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983566e6-3316-43e2-b206-a64e8d7a7a74 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:03.156556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:03.159230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e25056-9db1-41e8-a172-66c6c9e7828e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:03.159878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25056-9db1-41e8-a172-66c6c9e7828e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:03.160354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25056-9db1-41e8-a172-66c6c9e7828e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:03.160792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25056-9db1-41e8-a172-66c6c9e7828e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:03.162653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a0e25056-9db1-41e8-a172-66c6c9e7828e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:03.279121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e25056-9db1-41e8-a172-66c6c9e7828e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:03.280593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e25056-9db1-41e8-a172-66c6c9e7828e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:03.299417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 652/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:05.604614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecb2c-1582-408a-b811-456d63e42b41 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:05.605322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecb2c-1582-408a-b811-456d63e42b41 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:05.605322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecb2c-1582-408a-b811-456d63e42b41 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:05.608326 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 663/1315] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:05.613436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cf07-e017-475a-9aee-865f5a0abb23 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:05.613840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cf07-e017-475a-9aee-865f5a0abb23 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:05.613987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cf07-e017-475a-9aee-865f5a0abb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:05.679268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d593cf07-e017-475a-9aee-865f5a0abb23 None None] MFA Rules not processed for user `cdc5991a814845be880831d8c2a0b67c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:05.680458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d593cf07-e017-475a-9aee-865f5a0abb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:05.731493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:05.777202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 653/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:05.816252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecb2c-1582-408a-b811-456d63e42b41 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:05.817786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-17cecb2c-1582-408a-b811-456d63e42b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:05.828210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:05.921106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecb2c-1582-408a-b811-456d63e42b41 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:05.991999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78608-2ce4-4936-a6b6-c20d9c387165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:05.992618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78608-2ce4-4936-a6b6-c20d9c387165 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:05.992897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78608-2ce4-4936-a6b6-c20d9c387165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:05.993168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78608-2ce4-4936-a6b6-c20d9c387165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:05.994790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5ce78608-2ce4-4936-a6b6-c20d9c387165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:06.055305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:06.102502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce78608-2ce4-4936-a6b6-c20d9c387165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:06.103963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce78608-2ce4-4936-a6b6-c20d9c387165 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:06.121425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 664/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:08.703350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a9e4-4d25-48f7-ae1a-49427b90d4ae None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:08.703919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a9e4-4d25-48f7-ae1a-49427b90d4ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:08.703919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a9e4-4d25-48f7-ae1a-49427b90d4ae None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:08.705203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 654/1318] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:08.710266 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255f1f-ca60-4421-a8fc-4dd3c7f42d1a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:08.710671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255f1f-ca60-4421-a8fc-4dd3c7f42d1a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:08.710825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255f1f-ca60-4421-a8fc-4dd3c7f42d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:08.776424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1b255f1f-ca60-4421-a8fc-4dd3c7f42d1a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:08.777702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1b255f1f-ca60-4421-a8fc-4dd3c7f42d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:08.872052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 665/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:08.926080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79ed7-5049-4cd5-9645-29f6e5920d72 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:08.926362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79ed7-5049-4cd5-9645-29f6e5920d72 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:08.926639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79ed7-5049-4cd5-9645-29f6e5920d72 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:08.928079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 655/1320] 10.222.0.20 () {54 vars in 965 bytes} [Sun Jul 31 18:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:08.933821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb457e62-c3eb-47c9-8f13-2920722d5a9f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:08.934675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb457e62-c3eb-47c9-8f13-2920722d5a9f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:08.935095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb457e62-c3eb-47c9-8f13-2920722d5a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:08.957289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:09.011473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fb457e62-c3eb-47c9-8f13-2920722d5a9f None None] MFA Rules not processed for user `235416b3ebfc42f48be079760f271fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:09.013485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fb457e62-c3eb-47c9-8f13-2920722d5a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:09.085633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 666/1321] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Jul 31 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:09.095331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e79ed7-5049-4cd5-9645-29f6e5920d72 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:09.096845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49e79ed7-5049-4cd5-9645-29f6e5920d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:09.200016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e79ed7-5049-4cd5-9645-29f6e5920d72 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:09.271825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59b8a7-c2f6-44c6-b080-7ccead12962b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:09.272445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b8a7-c2f6-44c6-b080-7ccead12962b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:09.272724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b8a7-c2f6-44c6-b080-7ccead12962b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:09.272996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b8a7-c2f6-44c6-b080-7ccead12962b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:09.274612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0a59b8a7-c2f6-44c6-b080-7ccead12962b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:09.282739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:09.381883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59b8a7-c2f6-44c6-b080-7ccead12962b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:09.383606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59b8a7-c2f6-44c6-b080-7ccead12962b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:09.401452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 656/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:12.578980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3adbf-0be2-4ae3-9a48-ee5be0238a29 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:12.579538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3adbf-0be2-4ae3-9a48-ee5be0238a29 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:12.579538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3adbf-0be2-4ae3-9a48-ee5be0238a29 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:12.580883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 667/1323] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:12.586157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe4100-1dc0-44e6-9216-1d88d8dd0b2d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:12.586588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe4100-1dc0-44e6-9216-1d88d8dd0b2d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:12.586720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe4100-1dc0-44e6-9216-1d88d8dd0b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:12.654198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bdfe4100-1dc0-44e6-9216-1d88d8dd0b2d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:12.655464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bdfe4100-1dc0-44e6-9216-1d88d8dd0b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:12.718616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:12.760452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 657/1324] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:12.797361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3adbf-0be2-4ae3-9a48-ee5be0238a29 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:12.798907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5cd3adbf-0be2-4ae3-9a48-ee5be0238a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:12.908716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3adbf-0be2-4ae3-9a48-ee5be0238a29 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:12.921707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:12.984323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b1d77-e37f-4071-8aaa-07bbaa5f905b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:12.984861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1d77-e37f-4071-8aaa-07bbaa5f905b service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:12.985139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1d77-e37f-4071-8aaa-07bbaa5f905b service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:12.985411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1d77-e37f-4071-8aaa-07bbaa5f905b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:12.987067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4e3b1d77-e37f-4071-8aaa-07bbaa5f905b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:13.096188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b1d77-e37f-4071-8aaa-07bbaa5f905b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:13.097562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b1d77-e37f-4071-8aaa-07bbaa5f905b service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:13.115686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 668/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:15.194706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b11b-c740-482f-8a39-0494897e3a1e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:15.195252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b11b-c740-482f-8a39-0494897e3a1e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:15.195252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b11b-c740-482f-8a39-0494897e3a1e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:15.196551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 658/1326] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:15.202191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df7ef-40fb-47cf-a075-c2a0c13b4dcd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:15.202590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df7ef-40fb-47cf-a075-c2a0c13b4dcd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:15.202737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df7ef-40fb-47cf-a075-c2a0c13b4dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:15.250431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:15.268736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-630df7ef-40fb-47cf-a075-c2a0c13b4dcd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:15.269959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-630df7ef-40fb-47cf-a075-c2a0c13b4dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:15.367127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 669/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:15.404096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17b11b-c740-482f-8a39-0494897e3a1e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:15.405669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d17b11b-c740-482f-8a39-0494897e3a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:15.514473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17b11b-c740-482f-8a39-0494897e3a1e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:15.591196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bd9a0-2ae0-44d0-bfb5-5bfd0f07696a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:15.591838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bd9a0-2ae0-44d0-bfb5-5bfd0f07696a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:15.592118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bd9a0-2ae0-44d0-bfb5-5bfd0f07696a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:15.592390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bd9a0-2ae0-44d0-bfb5-5bfd0f07696a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:15.594061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e42bd9a0-2ae0-44d0-bfb5-5bfd0f07696a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:15.611123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:15.703378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bd9a0-2ae0-44d0-bfb5-5bfd0f07696a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:15.704832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bd9a0-2ae0-44d0-bfb5-5bfd0f07696a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:15.723143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 659/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:17.810537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983dac-d9e4-4cf3-93e6-a6a5078fcfb8 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:17.811151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983dac-d9e4-4cf3-93e6-a6a5078fcfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:17.811238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983dac-d9e4-4cf3-93e6-a6a5078fcfb8 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:17.812540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 670/1329] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:17.819106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5d477-c936-4bec-9a47-fcf5b8e001cd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:17.819553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5d477-c936-4bec-9a47-fcf5b8e001cd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:17.819650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5d477-c936-4bec-9a47-fcf5b8e001cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:17.889697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d7f5d477-c936-4bec-9a47-fcf5b8e001cd None None] MFA Rules not processed for user `cdc5991a814845be880831d8c2a0b67c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:17.890962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7f5d477-c936-4bec-9a47-fcf5b8e001cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:17.956848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:17.992078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 660/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:18.030290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983dac-d9e4-4cf3-93e6-a6a5078fcfb8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:18.031936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a9983dac-d9e4-4cf3-93e6-a6a5078fcfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:18.134791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983dac-d9e4-4cf3-93e6-a6a5078fcfb8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:18.155302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:18.209889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a6999-3575-4573-9621-e18edf3b3939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:18.210511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a6999-3575-4573-9621-e18edf3b3939 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:18.210784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a6999-3575-4573-9621-e18edf3b3939 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:18.211084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a6999-3575-4573-9621-e18edf3b3939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:18.212732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-686a6999-3575-4573-9621-e18edf3b3939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:18.320218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a6999-3575-4573-9621-e18edf3b3939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:18.321656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a6999-3575-4573-9621-e18edf3b3939 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:18.339236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 671/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:20.604486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175ad20-83a7-4c59-8cf8-fd67da115dc0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:20.605518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175ad20-83a7-4c59-8cf8-fd67da115dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:20.605640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175ad20-83a7-4c59-8cf8-fd67da115dc0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:20.606987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 661/1332] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:20.612125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d66f0-4c8c-4ee3-a2e2-fc4f16673230 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:20.612539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d66f0-4c8c-4ee3-a2e2-fc4f16673230 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:20.612675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d66f0-4c8c-4ee3-a2e2-fc4f16673230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:20.675288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:20.677937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9d1d66f0-4c8c-4ee3-a2e2-fc4f16673230 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:20.679735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9d1d66f0-4c8c-4ee3-a2e2-fc4f16673230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:20.774243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 672/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:20.810912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175ad20-83a7-4c59-8cf8-fd67da115dc0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:20.812495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6175ad20-83a7-4c59-8cf8-fd67da115dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:20.916493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175ad20-83a7-4c59-8cf8-fd67da115dc0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:20.989913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e17eb6-c27e-4d4e-ba6f-037123ca60e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:20.990527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e17eb6-c27e-4d4e-ba6f-037123ca60e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:20.990807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e17eb6-c27e-4d4e-ba6f-037123ca60e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:20.991110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e17eb6-c27e-4d4e-ba6f-037123ca60e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:20.992726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d8e17eb6-c27e-4d4e-ba6f-037123ca60e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:21.019332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:21.099141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e17eb6-c27e-4d4e-ba6f-037123ca60e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:21.100617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e17eb6-c27e-4d4e-ba6f-037123ca60e3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:21.118759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 662/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:23.186656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7c3a-de02-4631-89b2-75706220a0be None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:23.187345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7c3a-de02-4631-89b2-75706220a0be None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:23.187345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7c3a-de02-4631-89b2-75706220a0be None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:23.188604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 673/1335] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:23.193690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94acb-6460-4328-a336-ed4592b50338 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:23.194169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94acb-6460-4328-a336-ed4592b50338 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:23.194272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94acb-6460-4328-a336-ed4592b50338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:23.259883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b3a94acb-6460-4328-a336-ed4592b50338 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:23.261510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3a94acb-6460-4328-a336-ed4592b50338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:23.338875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:23.362409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 663/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:23.402582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e7c3a-de02-4631-89b2-75706220a0be None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:23.404833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2e3e7c3a-de02-4631-89b2-75706220a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:23.509272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e7c3a-de02-4631-89b2-75706220a0be None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:23.537434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:23.582396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015385b-d057-48be-ab3a-61057073483a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:23.583043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015385b-d057-48be-ab3a-61057073483a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:23.583325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015385b-d057-48be-ab3a-61057073483a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:23.583599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015385b-d057-48be-ab3a-61057073483a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:23.585243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2015385b-d057-48be-ab3a-61057073483a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:23.692949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015385b-d057-48be-ab3a-61057073483a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:23.694393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015385b-d057-48be-ab3a-61057073483a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:23.711983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 674/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:26.084523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d399-b0d7-4634-b4d2-f72d26ce7c67 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:26.085094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d399-b0d7-4634-b4d2-f72d26ce7c67 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:26.085094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d399-b0d7-4634-b4d2-f72d26ce7c67 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:26.086440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 664/1338] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:26.092425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedb9b-579e-43b5-b85e-18e9293022c0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:26.092869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedb9b-579e-43b5-b85e-18e9293022c0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:26.092869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedb9b-579e-43b5-b85e-18e9293022c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:26.158991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-39eedb9b-579e-43b5-b85e-18e9293022c0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:26.160189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-39eedb9b-579e-43b5-b85e-18e9293022c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:26.168263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:26.254621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 675/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:26.290964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598d399-b0d7-4634-b4d2-f72d26ce7c67 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:26.292497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9598d399-b0d7-4634-b4d2-f72d26ce7c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:26.399138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598d399-b0d7-4634-b4d2-f72d26ce7c67 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:26.471841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a7fe0-1371-4f23-ab45-70ba45d0d7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:26.472480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a7fe0-1371-4f23-ab45-70ba45d0d7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:26.472753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a7fe0-1371-4f23-ab45-70ba45d0d7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:26.473020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a7fe0-1371-4f23-ab45-70ba45d0d7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:26.474620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3c2a7fe0-1371-4f23-ab45-70ba45d0d7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:26.510130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:26.582476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a7fe0-1371-4f23-ab45-70ba45d0d7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:26.583940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a7fe0-1371-4f23-ab45-70ba45d0d7a0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:26.601831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 665/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:30.698791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e61310-e717-4d27-85eb-21e17b742a73 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:30.699322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e61310-e717-4d27-85eb-21e17b742a73 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:30.699550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e61310-e717-4d27-85eb-21e17b742a73 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:30.700919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 676/1341] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:30.706390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025afd-47f1-47db-ba30-bf0cbdd9f9cd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:30.706831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025afd-47f1-47db-ba30-bf0cbdd9f9cd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:30.707082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025afd-47f1-47db-ba30-bf0cbdd9f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:30.773777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-55025afd-47f1-47db-ba30-bf0cbdd9f9cd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:30.775008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55025afd-47f1-47db-ba30-bf0cbdd9f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:30.862291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:30.875438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 666/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:30.914773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e61310-e717-4d27-85eb-21e17b742a73 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:30.916559 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-97e61310-e717-4d27-85eb-21e17b742a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:31.022257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e61310-e717-4d27-85eb-21e17b742a73 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:31.061247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:31.096420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f5310-6af6-4259-8c44-9dd976be0839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:31.097042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5310-6af6-4259-8c44-9dd976be0839 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:31.097317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5310-6af6-4259-8c44-9dd976be0839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:31.097583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5310-6af6-4259-8c44-9dd976be0839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:31.099225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3b4f5310-6af6-4259-8c44-9dd976be0839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:31.215757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f5310-6af6-4259-8c44-9dd976be0839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:31.217183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f5310-6af6-4259-8c44-9dd976be0839 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:31.235492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 677/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:33.879179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b549-362b-4a98-a709-7bf0204d427d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:33.879750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b549-362b-4a98-a709-7bf0204d427d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:33.879750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b549-362b-4a98-a709-7bf0204d427d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:33.881107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 667/1344] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:29:33.887063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91aaa0-d998-4910-8b51-3aeb6b91a09a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:33.887580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91aaa0-d998-4910-8b51-3aeb6b91a09a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:33.887672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91aaa0-d998-4910-8b51-3aeb6b91a09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:33.960229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4d91aaa0-d998-4910-8b51-3aeb6b91a09a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:33.961505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4d91aaa0-d998-4910-8b51-3aeb6b91a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:33.983127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:34.065343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 678/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:34.103909 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802b549-362b-4a98-a709-7bf0204d427d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:34.105880 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a802b549-362b-4a98-a709-7bf0204d427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:34.216042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802b549-362b-4a98-a709-7bf0204d427d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:34.287238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493ffda-0bc4-4bff-b530-ddfa17020a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:34.287860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ffda-0bc4-4bff-b530-ddfa17020a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:34.288139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ffda-0bc4-4bff-b530-ddfa17020a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:34.288414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ffda-0bc4-4bff-b530-ddfa17020a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:34.290026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b493ffda-0bc4-4bff-b530-ddfa17020a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:34.332406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:34.400213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493ffda-0bc4-4bff-b530-ddfa17020a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:34.401697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493ffda-0bc4-4bff-b530-ddfa17020a43 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:34.420131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 668/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:38.493142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c970aa-3f63-4080-a925-79fbcc5e8e31 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:38.493695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c970aa-3f63-4080-a925-79fbcc5e8e31 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:38.493695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c970aa-3f63-4080-a925-79fbcc5e8e31 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:38.495118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 679/1347] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:38.500265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519bb39-88f2-4dc0-b631-3c0531426014 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:38.500675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519bb39-88f2-4dc0-b631-3c0531426014 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:38.500825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519bb39-88f2-4dc0-b631-3c0531426014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:38.567302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6519bb39-88f2-4dc0-b631-3c0531426014 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:38.568534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6519bb39-88f2-4dc0-b631-3c0531426014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:38.669811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:38.672375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 669/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:38.710838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c970aa-3f63-4080-a925-79fbcc5e8e31 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:38.712413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-53c970aa-3f63-4080-a925-79fbcc5e8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:38.832758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c970aa-3f63-4080-a925-79fbcc5e8e31 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:38.889518 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:38.917971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac4b6c-bb17-4bd9-b635-fa779f976ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:38.918601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4b6c-bb17-4bd9-b635-fa779f976ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:38.918875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4b6c-bb17-4bd9-b635-fa779f976ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:38.919175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4b6c-bb17-4bd9-b635-fa779f976ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:38.920891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5fac4b6c-bb17-4bd9-b635-fa779f976ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:39.038523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac4b6c-bb17-4bd9-b635-fa779f976ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:39.040027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac4b6c-bb17-4bd9-b635-fa779f976ccf service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:39.061302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 680/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:43.969361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05909-8706-47bf-82bf-45faf584cc71 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:43.970202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05909-8706-47bf-82bf-45faf584cc71 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:43.970712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05909-8706-47bf-82bf-45faf584cc71 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:43.972401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 670/1350] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:43.978385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a019e2d-ad14-4ee2-8189-a27249ab4e84 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:43.978813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a019e2d-ad14-4ee2-8189-a27249ab4e84 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:43.979325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a019e2d-ad14-4ee2-8189-a27249ab4e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:44.121389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3a019e2d-ad14-4ee2-8189-a27249ab4e84 None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:44.122507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3a019e2d-ad14-4ee2-8189-a27249ab4e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:44.144671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:44.244969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 681/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:29:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:48.431189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6386e-4eff-4d03-a031-d813ec2c3fb1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:48.435098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6386e-4eff-4d03-a031-d813ec2c3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:48.435678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6386e-4eff-4d03-a031-d813ec2c3fb1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:48.437623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 671/1352] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:29:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:48.442646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d629a5-5d5c-4af3-9df5-8f6203204bf7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:48.443136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d629a5-5d5c-4af3-9df5-8f6203204bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:48.443217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d629a5-5d5c-4af3-9df5-8f6203204bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:48.524370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c8d629a5-5d5c-4af3-9df5-8f6203204bf7 None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:48.526302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c8d629a5-5d5c-4af3-9df5-8f6203204bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:48.600189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:48.639906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 682/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:29:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:49.928209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3d803-da8f-4d48-83d3-aa0bcac00023 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:49.928732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3d803-da8f-4d48-83d3-aa0bcac00023 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:49.928732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3d803-da8f-4d48-83d3-aa0bcac00023 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:49.930014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 672/1354] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:49.935089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a00d-315e-4662-acff-9c0a1dc6a8a1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:49.935502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a00d-315e-4662-acff-9c0a1dc6a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:49.935638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a00d-315e-4662-acff-9c0a1dc6a8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:50.015126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-beb9a00d-315e-4662-acff-9c0a1dc6a8a1 None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:50.016317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-beb9a00d-315e-4662-acff-9c0a1dc6a8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:50.121944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 683/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:29:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:53.601073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3d6d-79bb-4934-881f-55ba2c8b7a0a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:53.602222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3d6d-79bb-4934-881f-55ba2c8b7a0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:53.603777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3d6d-79bb-4934-881f-55ba2c8b7a0a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:53.606856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 673/1356] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:53.613981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37591f48-42f7-40f0-a8ff-3a957ea26c23 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:53.613981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37591f48-42f7-40f0-a8ff-3a957ea26c23 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:53.613981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37591f48-42f7-40f0-a8ff-3a957ea26c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:53.664421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:53.700851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-37591f48-42f7-40f0-a8ff-3a957ea26c23 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:53.702049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-37591f48-42f7-40f0-a8ff-3a957ea26c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:53.805718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 684/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:53.861481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c90f29-b039-45b0-adda-2ea88b81d4ce None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:53.862093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c90f29-b039-45b0-adda-2ea88b81d4ce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:53.862693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c90f29-b039-45b0-adda-2ea88b81d4ce None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:53.864528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 674/1358] 10.222.0.20 () {54 vars in 962 bytes} [Sun Jul 31 18:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:53.873692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3ad2-7240-42e8-adbb-8df290cf7a42 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:53.874235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3ad2-7240-42e8-adbb-8df290cf7a42 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:53.874708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3ad2-7240-42e8-adbb-8df290cf7a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:53.964231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-816e3ad2-7240-42e8-adbb-8df290cf7a42 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:53.965443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-816e3ad2-7240-42e8-adbb-8df290cf7a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:54.018410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:54.094519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 685/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Jul 31 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:54.102234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c90f29-b039-45b0-adda-2ea88b81d4ce None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:54.104228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-20c90f29-b039-45b0-adda-2ea88b81d4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:54.258216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c90f29-b039-45b0-adda-2ea88b81d4ce None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:54.333725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:54.375900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bd212-6492-4cf1-b816-586d1f98f78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:54.376429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bd212-6492-4cf1-b816-586d1f98f78d service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:54.376706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bd212-6492-4cf1-b816-586d1f98f78d service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:54.376977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bd212-6492-4cf1-b816-586d1f98f78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:54.378740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-910bd212-6492-4cf1-b816-586d1f98f78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:54.475136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bd212-6492-4cf1-b816-586d1f98f78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:54.476753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bd212-6492-4cf1-b816-586d1f98f78d service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:54.496106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 675/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:56.754742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839748-9ca3-454a-89fd-7bc6bdefeb09 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:56.755328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839748-9ca3-454a-89fd-7bc6bdefeb09 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:56.755328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839748-9ca3-454a-89fd-7bc6bdefeb09 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:56.756951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 686/1361] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:56.763253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea610ef-4c10-4f8e-9d51-4a22396d55c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:56.763806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea610ef-4c10-4f8e-9d51-4a22396d55c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:56.763806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea610ef-4c10-4f8e-9d51-4a22396d55c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:56.837481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aea610ef-4c10-4f8e-9d51-4a22396d55c3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:56.838856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aea610ef-4c10-4f8e-9d51-4a22396d55c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:56.879558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:56.958270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 676/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:29:56.997762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839748-9ca3-454a-89fd-7bc6bdefeb09 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:29:56.999445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-da839748-9ca3-454a-89fd-7bc6bdefeb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:57.184127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839748-9ca3-454a-89fd-7bc6bdefeb09 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:29:57.194543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:57.318814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926a12-8189-4bd5-b0e0-8be137bafd28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:29:57.319593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926a12-8189-4bd5-b0e0-8be137bafd28 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:57.319878 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926a12-8189-4bd5-b0e0-8be137bafd28 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:57.320152 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926a12-8189-4bd5-b0e0-8be137bafd28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:57.322712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-71926a12-8189-4bd5-b0e0-8be137bafd28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:29:57.421001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71926a12-8189-4bd5-b0e0-8be137bafd28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:29:57.422641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71926a12-8189-4bd5-b0e0-8be137bafd28 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:29:57.445497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 687/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:29:59.810495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27d07f-5b5e-499d-8bb5-fd058cb8c1f5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:59.811051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27d07f-5b5e-499d-8bb5-fd058cb8c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:59.811161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27d07f-5b5e-499d-8bb5-fd058cb8c1f5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:59.812453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 677/1364] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:29:59.819158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d37a78-3ce6-4fbd-9b6e-18223eac207a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:29:59.819596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d37a78-3ce6-4fbd-9b6e-18223eac207a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:29:59.819721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d37a78-3ce6-4fbd-9b6e-18223eac207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:29:59.836961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:59.913720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a2d37a78-3ce6-4fbd-9b6e-18223eac207a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:29:59.915547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a2d37a78-3ce6-4fbd-9b6e-18223eac207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:00.021465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 688/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:00.068043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad3a7-8718-4c7d-b49d-055681d64042 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:00.068506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad3a7-8718-4c7d-b49d-055681d64042 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:00.068859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad3a7-8718-4c7d-b49d-055681d64042 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:00.070551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 678/1366] 10.222.0.20 () {54 vars in 962 bytes} [Sun Jul 31 18:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:00.076967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352bec4-259e-40ab-8abf-6e91a2c23e7f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:00.077265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352bec4-259e-40ab-8abf-6e91a2c23e7f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:00.077535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352bec4-259e-40ab-8abf-6e91a2c23e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:00.160073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e352bec4-259e-40ab-8abf-6e91a2c23e7f None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:00.161338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e352bec4-259e-40ab-8abf-6e91a2c23e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:00.198568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:00.284195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 689/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Jul 31 18:30:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:00.292101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adad3a7-8718-4c7d-b49d-055681d64042 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:00.293604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8adad3a7-8718-4c7d-b49d-055681d64042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:00.458363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adad3a7-8718-4c7d-b49d-055681d64042 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:00.479671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:00.576195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec82b8-c4fc-4f1d-9a2f-51924c22bc5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:00.576820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec82b8-c4fc-4f1d-9a2f-51924c22bc5a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:00.577098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec82b8-c4fc-4f1d-9a2f-51924c22bc5a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:00.577368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec82b8-c4fc-4f1d-9a2f-51924c22bc5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:00.579012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c6ec82b8-c4fc-4f1d-9a2f-51924c22bc5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:00.671299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec82b8-c4fc-4f1d-9a2f-51924c22bc5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:00.672842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec82b8-c4fc-4f1d-9a2f-51924c22bc5a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:00.692104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 679/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:01.743144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b951bf-408d-4cc7-9963-a74173e35792 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:01.743670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b951bf-408d-4cc7-9963-a74173e35792 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:01.743756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b951bf-408d-4cc7-9963-a74173e35792 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:01.745314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 690/1369] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:01.750471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16566-662f-4619-afce-fa5446f1a3ee None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:01.750893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16566-662f-4619-afce-fa5446f1a3ee None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:01.751113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16566-662f-4619-afce-fa5446f1a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:01.785715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:01.824695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-62b16566-662f-4619-afce-fa5446f1a3ee None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:01.825912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-62b16566-662f-4619-afce-fa5446f1a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:01.936147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 680/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:30:02.288668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18896-5b31-4676-8f81-56c040a1042a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:02.288961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18896-5b31-4676-8f81-56c040a1042a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:02.289239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18896-5b31-4676-8f81-56c040a1042a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:02.294699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 691/1371] 10.222.0.20 () {54 vars in 964 bytes} [Sun Jul 31 18:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:02.296308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8996-8e1b-4086-a4fe-500ddaf69dad None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:02.296605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8996-8e1b-4086-a4fe-500ddaf69dad None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:02.296895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8996-8e1b-4086-a4fe-500ddaf69dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:02.378522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6d1d8996-8e1b-4086-a4fe-500ddaf69dad None None] MFA Rules not processed for user `b9970bd7f09446339fb291e591cdfbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:02.379784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d1d8996-8e1b-4086-a4fe-500ddaf69dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:02.436226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:02.472001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 681/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Jul 31 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:02.480745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18896-5b31-4676-8f81-56c040a1042a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:02.482371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c3d18896-5b31-4676-8f81-56c040a1042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:02.595440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18896-5b31-4676-8f81-56c040a1042a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:02.640323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:02.676950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:02.677649 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:02.677927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:02.678199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:02.679876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:02.798680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:02.800271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:02.813754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d657-d4bd-416b-be19-fdb7b6da6b52 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:02.814259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d657-d4bd-416b-be19-fdb7b6da6b52 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:02.814759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d657-d4bd-416b-be19-fdb7b6da6b52 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:02.816407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 682/1373] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:02.823381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e01f-049a-4999-a5df-e8ab3c78ec59 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:02.823381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e01f-049a-4999-a5df-e8ab3c78ec59 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:02.823854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e01f-049a-4999-a5df-e8ab3c78ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:02.823978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 692/1374] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:02.914302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e2a3e01f-049a-4999-a5df-e8ab3c78ec59 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:02.917885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e2a3e01f-049a-4999-a5df-e8ab3c78ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:03.053177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 683/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:03.098061 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:03.099206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:03.170572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:03.205804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574af7c2-7f9a-430d-84f0-d7cc0053c2ee service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:03.335168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e1ed-dfc5-4fff-aae4-5265ad93e677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:03.335727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e1ed-dfc5-4fff-aae4-5265ad93e677 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:03.336008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e1ed-dfc5-4fff-aae4-5265ad93e677 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:03.336809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e1ed-dfc5-4fff-aae4-5265ad93e677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:03.338437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2078e1ed-dfc5-4fff-aae4-5265ad93e677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:03.417251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:03.430696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e1ed-dfc5-4fff-aae4-5265ad93e677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:03.432852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e1ed-dfc5-4fff-aae4-5265ad93e677 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:03.451123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 693/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:05.490080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bdc46-4323-46ab-8de6-fa80ee233749 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:05.490548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bdc46-4323-46ab-8de6-fa80ee233749 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:05.490957 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bdc46-4323-46ab-8de6-fa80ee233749 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:05.495104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 684/1377] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:05.498640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de652-a7ca-47eb-b811-0720e78dd4fd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:05.499262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de652-a7ca-47eb-b811-0720e78dd4fd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:05.499372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de652-a7ca-47eb-b811-0720e78dd4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:05.565390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cd2de652-a7ca-47eb-b811-0720e78dd4fd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:05.566662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cd2de652-a7ca-47eb-b811-0720e78dd4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:05.668252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 694/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:05.713268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bdc46-4323-46ab-8de6-fa80ee233749 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:05.714854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-779bdc46-4323-46ab-8de6-fa80ee233749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:05.809852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:05.923586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bdc46-4323-46ab-8de6-fa80ee233749 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:06.038178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85406b-9383-4ea9-be4e-056b8dbcd8bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:06.038798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85406b-9383-4ea9-be4e-056b8dbcd8bc service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:06.039104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85406b-9383-4ea9-be4e-056b8dbcd8bc service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:06.039440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85406b-9383-4ea9-be4e-056b8dbcd8bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:06.041172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e85406b-9383-4ea9-be4e-056b8dbcd8bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:06.052817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:06.141200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85406b-9383-4ea9-be4e-056b8dbcd8bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:06.142811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85406b-9383-4ea9-be4e-056b8dbcd8bc service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:06.161325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 685/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:08.302295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bf4b4-1a84-4725-b3ee-166b69956d05 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:08.302870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bf4b4-1a84-4725-b3ee-166b69956d05 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:08.303132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bf4b4-1a84-4725-b3ee-166b69956d05 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:08.304875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 695/1380] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:08.309972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136bcd-691a-4a06-8818-0cf86a2ea02d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:08.310384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136bcd-691a-4a06-8818-0cf86a2ea02d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:08.310594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136bcd-691a-4a06-8818-0cf86a2ea02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:08.389235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f4136bcd-691a-4a06-8818-0cf86a2ea02d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:08.390551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4136bcd-691a-4a06-8818-0cf86a2ea02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:08.491101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:08.504666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 686/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:08.550334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bf4b4-1a84-4725-b3ee-166b69956d05 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:08.551892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-eb2bf4b4-1a84-4725-b3ee-166b69956d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:08.618049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:08.713731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bf4b4-1a84-4725-b3ee-166b69956d05 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:08.835853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386db68-e27e-4e43-aa95-f6156cef2103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:08.836520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386db68-e27e-4e43-aa95-f6156cef2103 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:08.836818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386db68-e27e-4e43-aa95-f6156cef2103 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:08.837067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386db68-e27e-4e43-aa95-f6156cef2103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:08.838703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b386db68-e27e-4e43-aa95-f6156cef2103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:08.862123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:08.937698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386db68-e27e-4e43-aa95-f6156cef2103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:08.939345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386db68-e27e-4e43-aa95-f6156cef2103 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:08.958374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 696/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:11.098550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e4cd-4ff3-4b9e-9b43-253fd01fa55c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:11.099164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e4cd-4ff3-4b9e-9b43-253fd01fa55c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:11.099164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e4cd-4ff3-4b9e-9b43-253fd01fa55c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:11.100492 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 687/1383] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:11.107424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e3496-211b-4e71-bf7a-45df5326ae8b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:11.107906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e3496-211b-4e71-bf7a-45df5326ae8b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:11.108158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e3496-211b-4e71-bf7a-45df5326ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:11.184037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a05e3496-211b-4e71-bf7a-45df5326ae8b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:11.185244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a05e3496-211b-4e71-bf7a-45df5326ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:11.285205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:11.288761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 697/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:11.330391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25e4cd-4ff3-4b9e-9b43-253fd01fa55c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:11.331925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fb25e4cd-4ff3-4b9e-9b43-253fd01fa55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:11.484564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25e4cd-4ff3-4b9e-9b43-253fd01fa55c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:11.560235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:11.628732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72f9c4-6f9f-4298-9322-0e646a83d833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:11.629310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72f9c4-6f9f-4298-9322-0e646a83d833 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:11.629520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72f9c4-6f9f-4298-9322-0e646a83d833 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:11.629758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72f9c4-6f9f-4298-9322-0e646a83d833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:11.631832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-be72f9c4-6f9f-4298-9322-0e646a83d833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:11.744172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72f9c4-6f9f-4298-9322-0e646a83d833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:11.746383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72f9c4-6f9f-4298-9322-0e646a83d833 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:11.769580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 688/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:14.138706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584a93-da21-48d6-b571-53813953faed None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:14.139276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584a93-da21-48d6-b571-53813953faed None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:14.139276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584a93-da21-48d6-b571-53813953faed None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:14.140649 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 698/1386] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:14.147141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0407-0d93-4048-9710-497e0b022175 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:14.147562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0407-0d93-4048-9710-497e0b022175 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:14.147700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0407-0d93-4048-9710-497e0b022175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:14.219637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-083f0407-0d93-4048-9710-497e0b022175 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:14.220845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-083f0407-0d93-4048-9710-497e0b022175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:14.246731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:14.321804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 689/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:14.368802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584a93-da21-48d6-b571-53813953faed None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:14.370850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-da584a93-da21-48d6-b571-53813953faed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:14.519361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584a93-da21-48d6-b571-53813953faed None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:14.596891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:14.645914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f86ba-c953-4f67-90d3-835b56a3d4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:14.646538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f86ba-c953-4f67-90d3-835b56a3d4e5 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:14.646819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f86ba-c953-4f67-90d3-835b56a3d4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:14.647118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f86ba-c953-4f67-90d3-835b56a3d4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:14.649072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-585f86ba-c953-4f67-90d3-835b56a3d4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:14.750446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f86ba-c953-4f67-90d3-835b56a3d4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:14.752678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f86ba-c953-4f67-90d3-835b56a3d4e5 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:14.778153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 699/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:17.093755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434e02-87ed-4f06-99fe-34c1d46e2d58 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:17.094307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434e02-87ed-4f06-99fe-34c1d46e2d58 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:17.094307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434e02-87ed-4f06-99fe-34c1d46e2d58 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:17.095857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 690/1389] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:17.100800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a16935-dbed-4a5a-8fb8-d9df912d0463 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:17.101891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a16935-dbed-4a5a-8fb8-d9df912d0463 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:17.102149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a16935-dbed-4a5a-8fb8-d9df912d0463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:17.178127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-74a16935-dbed-4a5a-8fb8-d9df912d0463 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:17.179641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-74a16935-dbed-4a5a-8fb8-d9df912d0463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:17.217273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:17.283665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 700/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:17.332467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19434e02-87ed-4f06-99fe-34c1d46e2d58 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:17.333976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19434e02-87ed-4f06-99fe-34c1d46e2d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:17.496566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19434e02-87ed-4f06-99fe-34c1d46e2d58 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:17.507026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:17.622025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb289-2705-4898-aa59-b2f3269b47b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:17.622653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb289-2705-4898-aa59-b2f3269b47b6 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:17.622961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb289-2705-4898-aa59-b2f3269b47b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:17.623224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb289-2705-4898-aa59-b2f3269b47b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:17.625016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0cbcb289-2705-4898-aa59-b2f3269b47b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:17.727855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcb289-2705-4898-aa59-b2f3269b47b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:17.729415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcb289-2705-4898-aa59-b2f3269b47b6 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:17.748196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 691/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:18.016709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ed2c-564f-4aef-ab8f-5bb8a1812871 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:18.016996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ed2c-564f-4aef-ab8f-5bb8a1812871 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:18.017275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ed2c-564f-4aef-ab8f-5bb8a1812871 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:18.018692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 701/1392] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:18.024657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86764-e604-4ba7-bb36-e2a06b872aca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:18.024947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86764-e604-4ba7-bb36-e2a06b872aca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:18.025226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86764-e604-4ba7-bb36-e2a06b872aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:18.041436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:18.112297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-46e86764-e604-4ba7-bb36-e2a06b872aca None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:18.113655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46e86764-e604-4ba7-bb36-e2a06b872aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:18.219204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 692/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:18.277012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af114d5-ed44-464c-aecd-edaf104a4db1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:18.277499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af114d5-ed44-464c-aecd-edaf104a4db1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:18.277499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af114d5-ed44-464c-aecd-edaf104a4db1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:18.278840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 702/1394] 10.222.0.20 () {54 vars in 966 bytes} [Sun Jul 31 18:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:18.283998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901a00-af59-4d76-85d8-57dbb1147eff None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:18.284295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901a00-af59-4d76-85d8-57dbb1147eff None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:18.284577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901a00-af59-4d76-85d8-57dbb1147eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:18.362464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a0901a00-af59-4d76-85d8-57dbb1147eff None None] MFA Rules not processed for user `2f49e424f08d40c5880a8ce3ca1cac59`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:18.363717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a0901a00-af59-4d76-85d8-57dbb1147eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:18.399652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:18.442299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 693/1395] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Jul 31 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:18.449979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af114d5-ed44-464c-aecd-edaf104a4db1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:18.451517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0af114d5-ed44-464c-aecd-edaf104a4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:18.557560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af114d5-ed44-464c-aecd-edaf104a4db1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:18.620846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:18.633752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14ce6f-06b5-4709-9962-3ed29c197dfc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:18.634372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ce6f-06b5-4709-9962-3ed29c197dfc service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:18.634648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ce6f-06b5-4709-9962-3ed29c197dfc service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:18.634923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ce6f-06b5-4709-9962-3ed29c197dfc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:18.636597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d14ce6f-06b5-4709-9962-3ed29c197dfc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:18.748908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14ce6f-06b5-4709-9962-3ed29c197dfc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:18.750353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14ce6f-06b5-4709-9962-3ed29c197dfc service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:18.769253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 703/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:19.504332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c050-e939-414b-9f68-6169287438b2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:19.504809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c050-e939-414b-9f68-6169287438b2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:19.504908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c050-e939-414b-9f68-6169287438b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:19.576240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5258c050-e939-414b-9f68-6169287438b2 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:19.577428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5258c050-e939-414b-9f68-6169287438b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:19.664677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 694/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:19.716638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276728-f9b2-4234-b771-cc00a2cd9692 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:19.717138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276728-f9b2-4234-b771-cc00a2cd9692 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:19.717234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276728-f9b2-4234-b771-cc00a2cd9692 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:19.718569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 704/1398] 10.222.0.20 () {54 vars in 943 bytes} [Sun Jul 31 18:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:19.725028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacb779-d721-42f9-bfa4-3a5a036cfe94 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:19.725387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacb779-d721-42f9-bfa4-3a5a036cfe94 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:19.725764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacb779-d721-42f9-bfa4-3a5a036cfe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:19.785727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:19.805794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-efacb779-d721-42f9-bfa4-3a5a036cfe94 None None] MFA Rules not processed for user `25905fe87291438aa787ecada5cb6865`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:19.807028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-efacb779-d721-42f9-bfa4-3a5a036cfe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:19.845627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7ea5-69ee-4ac6-8bbc-dfd3c1beb8e2 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:19.845908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7ea5-69ee-4ac6-8bbc-dfd3c1beb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:19.846182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7ea5-69ee-4ac6-8bbc-dfd3c1beb8e2 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:19.847576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 705/1399] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:30:19.853083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:19.853353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:19.853619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:19.919532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:19.920730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:19.921260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 695/1400] 10.222.0.20 () {58 vars in 1040 bytes} [Sun Jul 31 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:19.931418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacb779-d721-42f9-bfa4-3a5a036cfe94 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:19.941026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacb779-d721-42f9-bfa4-3a5a036cfe94 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:19.965710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:20.022237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 706/1401] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:30:20.044010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:20.049594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462fe33-9b83-4518-9214-31d601868297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:20.050231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462fe33-9b83-4518-9214-31d601868297 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:20.050811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462fe33-9b83-4518-9214-31d601868297 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:20.051319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462fe33-9b83-4518-9214-31d601868297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:20.053634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5462fe33-9b83-4518-9214-31d601868297 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:20.068216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:20.069625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:20.142615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462fe33-9b83-4518-9214-31d601868297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:20.144273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462fe33-9b83-4518-9214-31d601868297 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:20.153211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 696/1402] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:30:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 18:30:20.187031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3aa4-8162-4e48-8584-75b9dfe52886 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:20.255801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:20.322784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31564c1f-54cf-4ca9-82ce-08c01a648689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:20.323454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564c1f-54cf-4ca9-82ce-08c01a648689 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:20.323740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564c1f-54cf-4ca9-82ce-08c01a648689 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:20.324013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564c1f-54cf-4ca9-82ce-08c01a648689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:20.325642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-31564c1f-54cf-4ca9-82ce-08c01a648689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:20.435043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31564c1f-54cf-4ca9-82ce-08c01a648689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:20.438990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31564c1f-54cf-4ca9-82ce-08c01a648689 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:20.464252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 707/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:30:22.567680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e0497-8804-4ef0-bd86-560eebb610ed None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:22.568217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e0497-8804-4ef0-bd86-560eebb610ed None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:22.568339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e0497-8804-4ef0-bd86-560eebb610ed None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:22.570569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 697/1404] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:22.575740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815997f-680e-4b74-95b6-99e8e37484a9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:22.576183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815997f-680e-4b74-95b6-99e8e37484a9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:22.576313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815997f-680e-4b74-95b6-99e8e37484a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:22.649007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2815997f-680e-4b74-95b6-99e8e37484a9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:22.650230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2815997f-680e-4b74-95b6-99e8e37484a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:22.668391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:22.764561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 708/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:22.811595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e0497-8804-4ef0-bd86-560eebb610ed None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:22.813240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e07e0497-8804-4ef0-bd86-560eebb610ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:22.977075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:22.989916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e0497-8804-4ef0-bd86-560eebb610ed None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:23.120335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0de29b-71c4-4d70-aff7-d29b5cc77b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:23.121229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de29b-71c4-4d70-aff7-d29b5cc77b60 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:23.121699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de29b-71c4-4d70-aff7-d29b5cc77b60 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:23.122137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de29b-71c4-4d70-aff7-d29b5cc77b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:23.124900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9d0de29b-71c4-4d70-aff7-d29b5cc77b60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:23.315308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de29b-71c4-4d70-aff7-d29b5cc77b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:23.317119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de29b-71c4-4d70-aff7-d29b5cc77b60 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:23.341342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:23.352652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 698/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:25.438303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629ca59-7eb4-4070-bc46-5e17bdb2986d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:25.438797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629ca59-7eb4-4070-bc46-5e17bdb2986d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:25.438889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629ca59-7eb4-4070-bc46-5e17bdb2986d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:25.446259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31be1-54c0-43d9-a74e-378c545c906f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:25.446783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31be1-54c0-43d9-a74e-378c545c906f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:25.446783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31be1-54c0-43d9-a74e-378c545c906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:25.451121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 709/1407] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:30:25 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:25.529459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c8b31be1-54c0-43d9-a74e-378c545c906f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:25.530916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c8b31be1-54c0-43d9-a74e-378c545c906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:25.644224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 699/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:25.690486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629ca59-7eb4-4070-bc46-5e17bdb2986d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:25.692051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4629ca59-7eb4-4070-bc46-5e17bdb2986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:25.867577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:25.869300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629ca59-7eb4-4070-bc46-5e17bdb2986d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:26.001994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035259f-e322-483e-be60-b460a6570454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:26.002627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035259f-e322-483e-be60-b460a6570454 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:26.002908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035259f-e322-483e-be60-b460a6570454 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:26.003212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035259f-e322-483e-be60-b460a6570454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:26.004869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2035259f-e322-483e-be60-b460a6570454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:26.114894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035259f-e322-483e-be60-b460a6570454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:26.116698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035259f-e322-483e-be60-b460a6570454 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:26.141009 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 710/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:35.642482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=67 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:36.138340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:42.840235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c5068-473c-4f38-9379-ef65a9e7df25 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:42.840851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c5068-473c-4f38-9379-ef65a9e7df25 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:42.840851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c5068-473c-4f38-9379-ef65a9e7df25 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:42.842193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 700/1410] 10.222.0.20 () {54 vars in 918 bytes} [Sun Jul 31 18:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:42.847202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b05c6-b026-4ba9-9d5b-24c7cf476bde None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:42.847648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b05c6-b026-4ba9-9d5b-24c7cf476bde None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:42.847763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b05c6-b026-4ba9-9d5b-24c7cf476bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:43.045652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-292b05c6-b026-4ba9-9d5b-24c7cf476bde None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:43.046853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-292b05c6-b026-4ba9-9d5b-24c7cf476bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:43.154816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 711/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Jul 31 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:43.169276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b02c7-9a9f-44ca-8b3f-5152811157ba None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:43.169557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b02c7-9a9f-44ca-8b3f-5152811157ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:43.169827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b02c7-9a9f-44ca-8b3f-5152811157ba None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:43.171207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 701/1412] 10.222.0.20 () {54 vars in 918 bytes} [Sun Jul 31 18:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:43.175679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f91221-03ca-4039-8833-925e57978ae8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:43.175966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f91221-03ca-4039-8833-925e57978ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:43.176238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f91221-03ca-4039-8833-925e57978ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:43.248784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:43.251393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f4f91221-03ca-4039-8833-925e57978ae8 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:43.253141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f4f91221-03ca-4039-8833-925e57978ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:43.364844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 712/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Jul 31 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:45.846953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f7d84-a238-4276-bc74-87874b1b797a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:45.847516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f7d84-a238-4276-bc74-87874b1b797a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:45.847516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f7d84-a238-4276-bc74-87874b1b797a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:45.848861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:45.854648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7625c5-276e-4b1c-893c-0f353c6f0c53 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:45.855127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7625c5-276e-4b1c-893c-0f353c6f0c53 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:45.855225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7625c5-276e-4b1c-893c-0f353c6f0c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:45.921441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7f7625c5-276e-4b1c-893c-0f353c6f0c53 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:45.922647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7f7625c5-276e-4b1c-893c-0f353c6f0c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:45.976750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:46.018082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:46.062007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f7d84-a238-4276-bc74-87874b1b797a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:46.063568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1e7f7d84-a238-4276-bc74-87874b1b797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:46.207800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f7d84-a238-4276-bc74-87874b1b797a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:46.280162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:46.321492 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897623-101b-4686-bf39-ae6ecd0a70fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:46.322106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897623-101b-4686-bf39-ae6ecd0a70fe service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:46.322380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897623-101b-4686-bf39-ae6ecd0a70fe service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:46.322646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897623-101b-4686-bf39-ae6ecd0a70fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:46.324321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c897623-101b-4686-bf39-ae6ecd0a70fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:46.411015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c897623-101b-4686-bf39-ae6ecd0a70fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:46.412632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c897623-101b-4686-bf39-ae6ecd0a70fe service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:46.431558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 703/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:47.331483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321d53-39ce-4637-9d99-19d81bcaa304 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:47.332060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321d53-39ce-4637-9d99-19d81bcaa304 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:47.332060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321d53-39ce-4637-9d99-19d81bcaa304 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:47.333371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:47.338380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14529-31be-4d63-9f6d-df179dd9dbb6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:47.338773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14529-31be-4d63-9f6d-df179dd9dbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:47.339076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14529-31be-4d63-9f6d-df179dd9dbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:47.412407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fce14529-31be-4d63-9f6d-df179dd9dbb6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:47.414130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fce14529-31be-4d63-9f6d-df179dd9dbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:47.443550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:47.513593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:47.667401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d321d53-39ce-4637-9d99-19d81bcaa304 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:47.668828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d321d53-39ce-4637-9d99-19d81bcaa304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:47.810453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d321d53-39ce-4637-9d99-19d81bcaa304 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:47.848598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:47.921492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceceec6-8193-4af2-904e-11a7b3a5dda8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:47.922035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceceec6-8193-4af2-904e-11a7b3a5dda8 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:47.922308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceceec6-8193-4af2-904e-11a7b3a5dda8 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:47.922575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceceec6-8193-4af2-904e-11a7b3a5dda8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:47.924272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bceceec6-8193-4af2-904e-11a7b3a5dda8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:48.010549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceceec6-8193-4af2-904e-11a7b3a5dda8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:48.012158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceceec6-8193-4af2-904e-11a7b3a5dda8 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:48.030044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 715/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:48.935271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f16e23-57d9-4a11-86bf-40a48d59e08b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:48.935871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f16e23-57d9-4a11-86bf-40a48d59e08b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:48.935871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f16e23-57d9-4a11-86bf-40a48d59e08b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:48.937184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:48.942083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af42d3-804b-4673-a66c-b1dee94d7c90 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:48.942532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af42d3-804b-4673-a66c-b1dee94d7c90 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:48.942628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af42d3-804b-4673-a66c-b1dee94d7c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:48.998345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:49.021127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a6af42d3-804b-4673-a66c-b1dee94d7c90 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:49.022347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a6af42d3-804b-4673-a66c-b1dee94d7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:49.118392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:49.269720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f16e23-57d9-4a11-86bf-40a48d59e08b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:49.271316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9f16e23-57d9-4a11-86bf-40a48d59e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:49.419317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f16e23-57d9-4a11-86bf-40a48d59e08b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:49.432053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:49.532530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aefa3-17ac-4b76-b99e-b108a803fa6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:49.533066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aefa3-17ac-4b76-b99e-b108a803fa6b service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:49.533340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aefa3-17ac-4b76-b99e-b108a803fa6b service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:49.533605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aefa3-17ac-4b76-b99e-b108a803fa6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:49.535242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c33aefa3-17ac-4b76-b99e-b108a803fa6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:49.623208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aefa3-17ac-4b76-b99e-b108a803fa6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:49.624853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aefa3-17ac-4b76-b99e-b108a803fa6b service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:49.643726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 706/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:50.526847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e95a6-af37-4807-bf1c-0b33a6108384 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:50.527441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e95a6-af37-4807-bf1c-0b33a6108384 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:50.527441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e95a6-af37-4807-bf1c-0b33a6108384 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:50.528785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:50.533666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48d9f-0863-4e0e-8733-6ffb97097969 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:50.534063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48d9f-0863-4e0e-8733-6ffb97097969 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:50.534204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48d9f-0863-4e0e-8733-6ffb97097969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:50.553904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:50.608768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-27e48d9f-0863-4e0e-8733-6ffb97097969 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:50.609964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-27e48d9f-0863-4e0e-8733-6ffb97097969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:50.704814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:50.856616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e95a6-af37-4807-bf1c-0b33a6108384 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:50.858131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-337e95a6-af37-4807-bf1c-0b33a6108384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:50.966754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:51.002552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e95a6-af37-4807-bf1c-0b33a6108384 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:51.113687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13548c2f-54e9-488e-8e3e-8309d191ced0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:51.114309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548c2f-54e9-488e-8e3e-8309d191ced0 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:51.114590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548c2f-54e9-488e-8e3e-8309d191ced0 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:51.114859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548c2f-54e9-488e-8e3e-8309d191ced0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:51.116532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-13548c2f-54e9-488e-8e3e-8309d191ced0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:51.193853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:51.207616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13548c2f-54e9-488e-8e3e-8309d191ced0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:51.209202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13548c2f-54e9-488e-8e3e-8309d191ced0 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:51.228479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 718/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:52.102940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ff933-5819-47bd-8f3f-024ca8efcdfc None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:52.103520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ff933-5819-47bd-8f3f-024ca8efcdfc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:52.103520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ff933-5819-47bd-8f3f-024ca8efcdfc None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:52.104890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:30:52.110041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a082-9b3f-4ec8-a469-0c35bb775659 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:52.110496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a082-9b3f-4ec8-a469-0c35bb775659 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:52.110595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a082-9b3f-4ec8-a469-0c35bb775659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:52.186804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0641a082-9b3f-4ec8-a469-0c35bb775659 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:52.188040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0641a082-9b3f-4ec8-a469-0c35bb775659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:52.281777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:52.432052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ff933-5819-47bd-8f3f-024ca8efcdfc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:52.433486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-598ff933-5819-47bd-8f3f-024ca8efcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:52.515768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:52.577485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ff933-5819-47bd-8f3f-024ca8efcdfc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:52.690092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c631-d262-461c-89fb-9aadb62969ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:52.690632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c631-d262-461c-89fb-9aadb62969ea service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:52.690910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c631-d262-461c-89fb-9aadb62969ea service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:52.691304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c631-d262-461c-89fb-9aadb62969ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:52.692938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3c46c631-d262-461c-89fb-9aadb62969ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:52.743313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:52.784603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c631-d262-461c-89fb-9aadb62969ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:52.786220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c631-d262-461c-89fb-9aadb62969ea service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:52.803715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 709/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:53.617134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd997-412f-4776-a6da-5a1557e61d4b None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:53.617680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd997-412f-4776-a6da-5a1557e61d4b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:53.617680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd997-412f-4776-a6da-5a1557e61d4b None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:53.618956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:53.624021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02491-0c79-42b7-9311-0b5389ccc93d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:53.624426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02491-0c79-42b7-9311-0b5389ccc93d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:53.624624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02491-0c79-42b7-9311-0b5389ccc93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:53.699177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-90f02491-0c79-42b7-9311-0b5389ccc93d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:53.700388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90f02491-0c79-42b7-9311-0b5389ccc93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:53.794391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:53.945119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd997-412f-4776-a6da-5a1557e61d4b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:53.946655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7c4cd997-412f-4776-a6da-5a1557e61d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:53.998462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:54.094368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd997-412f-4776-a6da-5a1557e61d4b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:54.207775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b297ba-28e0-46ef-873f-83a2f33a80be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:54.208305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b297ba-28e0-46ef-873f-83a2f33a80be service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:54.208584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b297ba-28e0-46ef-873f-83a2f33a80be service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:54.208855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b297ba-28e0-46ef-873f-83a2f33a80be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:54.210470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e8b297ba-28e0-46ef-873f-83a2f33a80be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:54.217867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:54.300751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b297ba-28e0-46ef-873f-83a2f33a80be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:54.302364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b297ba-28e0-46ef-873f-83a2f33a80be service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:54.321301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 721/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:55.129152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2e94-5429-42bd-9702-0a9d84912e74 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:55.129737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2e94-5429-42bd-9702-0a9d84912e74 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:55.129737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2e94-5429-42bd-9702-0a9d84912e74 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:55.131138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:55.137388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0d822-db03-4d61-834a-5f344ec24f93 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:55.137828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0d822-db03-4d61-834a-5f344ec24f93 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:55.137936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0d822-db03-4d61-834a-5f344ec24f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:55.213041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-90a0d822-db03-4d61-834a-5f344ec24f93 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:55.214234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-90a0d822-db03-4d61-834a-5f344ec24f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:55.280758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:55.309484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:55.464884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2e94-5429-42bd-9702-0a9d84912e74 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:55.466427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d0c2e94-5429-42bd-9702-0a9d84912e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:55.485216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:55.614517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2e94-5429-42bd-9702-0a9d84912e74 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:55.701614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:55.727320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ab71c-54d6-47ce-bc64-9767be9526c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:55.727975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ab71c-54d6-47ce-bc64-9767be9526c3 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:55.728256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ab71c-54d6-47ce-bc64-9767be9526c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:55.728527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ab71c-54d6-47ce-bc64-9767be9526c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:55.730151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-819ab71c-54d6-47ce-bc64-9767be9526c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:55.818866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ab71c-54d6-47ce-bc64-9767be9526c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:55.820712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ab71c-54d6-47ce-bc64-9767be9526c3 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:55.839112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 712/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:56.645954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b802-7efd-42e7-a237-5f5b1c33f6fc None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:56.646519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b802-7efd-42e7-a237-5f5b1c33f6fc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:56.646519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b802-7efd-42e7-a237-5f5b1c33f6fc None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:56.647805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:56.653137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3a7d-87e2-4e5b-90d9-6f1cef967c35 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:56.653562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3a7d-87e2-4e5b-90d9-6f1cef967c35 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:56.653668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3a7d-87e2-4e5b-90d9-6f1cef967c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:56.739616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e13c3a7d-87e2-4e5b-90d9-6f1cef967c35 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:56.740811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e13c3a7d-87e2-4e5b-90d9-6f1cef967c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:56.781243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:56.835347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:30:56.994097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b802-7efd-42e7-a237-5f5b1c33f6fc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:56.995558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3c70b802-7efd-42e7-a237-5f5b1c33f6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:57.143912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b802-7efd-42e7-a237-5f5b1c33f6fc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:57.197548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:57.255036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71384f-a6b2-4cf0-a7a8-662b71f00218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:57.255650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71384f-a6b2-4cf0-a7a8-662b71f00218 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:57.255925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71384f-a6b2-4cf0-a7a8-662b71f00218 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:57.256193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71384f-a6b2-4cf0-a7a8-662b71f00218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:57.258251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d71384f-a6b2-4cf0-a7a8-662b71f00218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:57.345297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71384f-a6b2-4cf0-a7a8-662b71f00218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:57.346900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71384f-a6b2-4cf0-a7a8-662b71f00218 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:57.365389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 724/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:58.169686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038342df-c270-4862-82ee-7c2a06aff987 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:58.170271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038342df-c270-4862-82ee-7c2a06aff987 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:58.170271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038342df-c270-4862-82ee-7c2a06aff987 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:58.171632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:30:58.176464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a543-7ed2-4ece-8ee8-16a24ecce90c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:58.176868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a543-7ed2-4ece-8ee8-16a24ecce90c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:58.177016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596a543-7ed2-4ece-8ee8-16a24ecce90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:58.252830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f596a543-7ed2-4ece-8ee8-16a24ecce90c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:30:58.254043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f596a543-7ed2-4ece-8ee8-16a24ecce90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:58.256078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:58.351259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:30:58.503571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038342df-c270-4862-82ee-7c2a06aff987 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:30:58.505011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-038342df-c270-4862-82ee-7c2a06aff987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:58.651229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038342df-c270-4862-82ee-7c2a06aff987 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:30:58.677489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:58.766971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb0d1-9dcc-44a4-8e87-374906c822b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:30:58.767521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb0d1-9dcc-44a4-8e87-374906c822b7 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:30:58.767794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb0d1-9dcc-44a4-8e87-374906c822b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:30:58.768059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb0d1-9dcc-44a4-8e87-374906c822b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:30:58.769665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-633cb0d1-9dcc-44a4-8e87-374906c822b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:30:58.855920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb0d1-9dcc-44a4-8e87-374906c822b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:30:58.857549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb0d1-9dcc-44a4-8e87-374906c822b7 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:30:58.875553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 715/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:00.798113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaadb7f-6bf3-456e-b3a9-c930695fb1dd None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:00.798688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaadb7f-6bf3-456e-b3a9-c930695fb1dd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:00.798688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaadb7f-6bf3-456e-b3a9-c930695fb1dd None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:00.800065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:00.805993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8c32b-17c9-47dc-b871-338463bcf94f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:00.806432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8c32b-17c9-47dc-b871-338463bcf94f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:00.806535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8c32b-17c9-47dc-b871-338463bcf94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:00.846337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:00.872660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d7e8c32b-17c9-47dc-b871-338463bcf94f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:00.873900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7e8c32b-17c9-47dc-b871-338463bcf94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:00.969895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:01.009482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaadb7f-6bf3-456e-b3a9-c930695fb1dd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:01.011113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-acaadb7f-6bf3-456e-b3a9-c930695fb1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:01.111748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaadb7f-6bf3-456e-b3a9-c930695fb1dd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:01.145407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:01.187069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd2af0-4349-44a8-8dac-f35f9638a4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:01.187701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2af0-4349-44a8-8dac-f35f9638a4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:01.188472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2af0-4349-44a8-8dac-f35f9638a4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:01.188472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2af0-4349-44a8-8dac-f35f9638a4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:01.189852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-18bd2af0-4349-44a8-8dac-f35f9638a4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:01.300047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd2af0-4349-44a8-8dac-f35f9638a4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:01.301415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd2af0-4349-44a8-8dac-f35f9638a4d0 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:01.319155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 727/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:31:03.475560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bf5f-d3be-49e5-92c7-b60a6bc49fc5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:03.476085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bf5f-d3be-49e5-92c7-b60a6bc49fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:03.476085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bf5f-d3be-49e5-92c7-b60a6bc49fc5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:03.478074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:03.483493 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887be07-2899-48a4-a27e-16388023662f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:03.483938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887be07-2899-48a4-a27e-16388023662f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:03.484050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887be07-2899-48a4-a27e-16388023662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:03.551705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b887be07-2899-48a4-a27e-16388023662f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:03.552907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b887be07-2899-48a4-a27e-16388023662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:03.565730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:03.651522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:03.689471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504bf5f-d3be-49e5-92c7-b60a6bc49fc5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:03.691053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4504bf5f-d3be-49e5-92c7-b60a6bc49fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:03.795530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504bf5f-d3be-49e5-92c7-b60a6bc49fc5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:03.807507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:03.868756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb8d06-a10e-4f7f-90f7-3fa372a9344b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:03.869376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8d06-a10e-4f7f-90f7-3fa372a9344b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:03.869658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8d06-a10e-4f7f-90f7-3fa372a9344b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:03.870047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8d06-a10e-4f7f-90f7-3fa372a9344b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:03.871593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-35bb8d06-a10e-4f7f-90f7-3fa372a9344b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:03.981497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb8d06-a10e-4f7f-90f7-3fa372a9344b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:03.983002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb8d06-a10e-4f7f-90f7-3fa372a9344b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:04.001172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 718/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:06.353957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899b21-f57f-4c09-b87c-a4ec59e3c9a1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:06.354552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899b21-f57f-4c09-b87c-a4ec59e3c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:06.354552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899b21-f57f-4c09-b87c-a4ec59e3c9a1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:06.355919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:06.361165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1529-4591-4db3-a9f9-c7a9cfa7e5ac None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:06.361616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1529-4591-4db3-a9f9-c7a9cfa7e5ac None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:06.361732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1529-4591-4db3-a9f9-c7a9cfa7e5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:06.408620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:06.427390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b10a1529-4591-4db3-a9f9-c7a9cfa7e5ac None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:06.428594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b10a1529-4591-4db3-a9f9-c7a9cfa7e5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:06.529832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:31:06.568699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899b21-f57f-4c09-b87c-a4ec59e3c9a1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:06.570235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-20899b21-f57f-4c09-b87c-a4ec59e3c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:06.674193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899b21-f57f-4c09-b87c-a4ec59e3c9a1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:06.713097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:06.746062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777616b-3079-4444-8e2c-1e6636fa6c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:06.746672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777616b-3079-4444-8e2c-1e6636fa6c3d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:06.746965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777616b-3079-4444-8e2c-1e6636fa6c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:06.747239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777616b-3079-4444-8e2c-1e6636fa6c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:06.748859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2777616b-3079-4444-8e2c-1e6636fa6c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:06.869103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777616b-3079-4444-8e2c-1e6636fa6c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:06.870532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777616b-3079-4444-8e2c-1e6636fa6c3d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:06.888186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 730/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:09.000160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325cf7-3f90-4b22-9319-c516adff742d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:09.000795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325cf7-3f90-4b22-9319-c516adff742d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:09.000795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325cf7-3f90-4b22-9319-c516adff742d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:09.002130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:09.007524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d899ec-6a3e-4cec-807f-381cc8297914 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:09.007953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d899ec-6a3e-4cec-807f-381cc8297914 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:09.008059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d899ec-6a3e-4cec-807f-381cc8297914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:09.073467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d0d899ec-6a3e-4cec-807f-381cc8297914 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:09.074668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d0d899ec-6a3e-4cec-807f-381cc8297914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:09.095494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:09.172737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:09.212433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325cf7-3f90-4b22-9319-c516adff742d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:09.214007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea325cf7-3f90-4b22-9319-c516adff742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:09.315989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325cf7-3f90-4b22-9319-c516adff742d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:09.335842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:09.390799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc209300-bd74-4cf5-bf13-084cba9b3977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:09.391481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209300-bd74-4cf5-bf13-084cba9b3977 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:09.391763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209300-bd74-4cf5-bf13-084cba9b3977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:09.392049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc209300-bd74-4cf5-bf13-084cba9b3977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:09.393671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bc209300-bd74-4cf5-bf13-084cba9b3977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:09.502687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc209300-bd74-4cf5-bf13-084cba9b3977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:09.504162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc209300-bd74-4cf5-bf13-084cba9b3977 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:09.522553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 721/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:11.576968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d697-0dae-4e48-8a07-e46312d5e52e None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:11.577527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d697-0dae-4e48-8a07-e46312d5e52e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:11.577527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d697-0dae-4e48-8a07-e46312d5e52e None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:11.578853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:11.584022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d522e5-7535-440d-805f-ec03592a79f1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:11.584436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d522e5-7535-440d-805f-ec03592a79f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:11.584577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d522e5-7535-440d-805f-ec03592a79f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:11.649542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:11.652223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-51d522e5-7535-440d-805f-ec03592a79f1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:11.654059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-51d522e5-7535-440d-805f-ec03592a79f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:11.749450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:11.788577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53d697-0dae-4e48-8a07-e46312d5e52e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:11.790707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-db53d697-0dae-4e48-8a07-e46312d5e52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:11.890608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53d697-0dae-4e48-8a07-e46312d5e52e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:11.938299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:11.963106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3e5fc-7029-4a03-8c2e-f064286a3e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:11.963713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e5fc-7029-4a03-8c2e-f064286a3e80 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:11.963988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e5fc-7029-4a03-8c2e-f064286a3e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:11.964258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e5fc-7029-4a03-8c2e-f064286a3e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:11.965858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aea3e5fc-7029-4a03-8c2e-f064286a3e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:12.070226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3e5fc-7029-4a03-8c2e-f064286a3e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:12.072198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3e5fc-7029-4a03-8c2e-f064286a3e80 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:12.089973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 733/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:14.134574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1474a-52c3-41f0-997f-f2ea6ac49281 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:14.135205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1474a-52c3-41f0-997f-f2ea6ac49281 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:14.135205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1474a-52c3-41f0-997f-f2ea6ac49281 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:14.136541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:14.141897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3efbf-84ab-47fd-9fd5-be5dca038320 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:14.142312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3efbf-84ab-47fd-9fd5-be5dca038320 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:14.142432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3efbf-84ab-47fd-9fd5-be5dca038320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:14.209947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fbe3efbf-84ab-47fd-9fd5-be5dca038320 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:14.211175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fbe3efbf-84ab-47fd-9fd5-be5dca038320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:14.240389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:14.308891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:14.347596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1474a-52c3-41f0-997f-f2ea6ac49281 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:14.349189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13f1474a-52c3-41f0-997f-f2ea6ac49281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:14.453520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1474a-52c3-41f0-997f-f2ea6ac49281 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:14.482005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:14.526644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd565c9-733e-4a98-9fc0-5e894e28c8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:14.527287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd565c9-733e-4a98-9fc0-5e894e28c8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:14.527565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd565c9-733e-4a98-9fc0-5e894e28c8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:14.527833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd565c9-733e-4a98-9fc0-5e894e28c8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:14.529464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6cd565c9-733e-4a98-9fc0-5e894e28c8d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:14.635729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd565c9-733e-4a98-9fc0-5e894e28c8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:14.637120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd565c9-733e-4a98-9fc0-5e894e28c8d4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:14.655694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 724/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:31:16.725305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552972-6ae4-44fb-b45c-f04628722272 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:16.725837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552972-6ae4-44fb-b45c-f04628722272 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:16.725837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552972-6ae4-44fb-b45c-f04628722272 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:16.727193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:16.732438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caec31-2baa-4cc8-8a40-417a9bd7fa87 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:16.732875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caec31-2baa-4cc8-8a40-417a9bd7fa87 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:16.732999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caec31-2baa-4cc8-8a40-417a9bd7fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:16.798116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-07caec31-2baa-4cc8-8a40-417a9bd7fa87 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:16.799351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-07caec31-2baa-4cc8-8a40-417a9bd7fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:16.808111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:16.896982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:16.935471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b552972-6ae4-44fb-b45c-f04628722272 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:16.937018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6b552972-6ae4-44fb-b45c-f04628722272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:17.045979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b552972-6ae4-44fb-b45c-f04628722272 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:17.100957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:17.119893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6891a-b22e-4950-8238-2fe61d7f8498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:17.120513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6891a-b22e-4950-8238-2fe61d7f8498 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:17.120795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6891a-b22e-4950-8238-2fe61d7f8498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:17.121071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6891a-b22e-4950-8238-2fe61d7f8498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:17.122696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7fc6891a-b22e-4950-8238-2fe61d7f8498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:17.234058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6891a-b22e-4950-8238-2fe61d7f8498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:17.235535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6891a-b22e-4950-8238-2fe61d7f8498 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:17.254204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 736/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:19.299287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc45e6-1823-4dc5-b3ef-6997c8e0c398 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:19.299845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc45e6-1823-4dc5-b3ef-6997c8e0c398 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:19.299845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc45e6-1823-4dc5-b3ef-6997c8e0c398 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:19.301214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:19.306956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5bad-3e9c-4ce6-bb24-8d4b16c16e40 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:19.307420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5bad-3e9c-4ce6-bb24-8d4b16c16e40 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:19.307564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5bad-3e9c-4ce6-bb24-8d4b16c16e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:19.373298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-31df5bad-3e9c-4ce6-bb24-8d4b16c16e40 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:19.374526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-31df5bad-3e9c-4ce6-bb24-8d4b16c16e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:19.412757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:19.471359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:19.510730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc45e6-1823-4dc5-b3ef-6997c8e0c398 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:19.512278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c8cc45e6-1823-4dc5-b3ef-6997c8e0c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:19.615127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc45e6-1823-4dc5-b3ef-6997c8e0c398 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:19.652421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:19.688370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0a7b-f22f-44b6-bfc4-144c9c723729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:19.689001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0a7b-f22f-44b6-bfc4-144c9c723729 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:19.689280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0a7b-f22f-44b6-bfc4-144c9c723729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:19.689550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0a7b-f22f-44b6-bfc4-144c9c723729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:19.691207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8ead0a7b-f22f-44b6-bfc4-144c9c723729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:19.801700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead0a7b-f22f-44b6-bfc4-144c9c723729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:19.803168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead0a7b-f22f-44b6-bfc4-144c9c723729 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:19.821567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 727/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:31:21.975392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948cb8e-98f3-4abd-8ce7-0ed02f07f191 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:21.975983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948cb8e-98f3-4abd-8ce7-0ed02f07f191 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:21.975983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948cb8e-98f3-4abd-8ce7-0ed02f07f191 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:21.977317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:21.982955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8604f7-5355-473a-b24f-dcd31f35ddce None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:21.983414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8604f7-5355-473a-b24f-dcd31f35ddce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:21.983515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8604f7-5355-473a-b24f-dcd31f35ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:22.049332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6e8604f7-5355-473a-b24f-dcd31f35ddce None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:22.050534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e8604f7-5355-473a-b24f-dcd31f35ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:22.068696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:22.147912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:22.185716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948cb8e-98f3-4abd-8ce7-0ed02f07f191 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:22.187340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1948cb8e-98f3-4abd-8ce7-0ed02f07f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:22.288798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948cb8e-98f3-4abd-8ce7-0ed02f07f191 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:22.353835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:22.360904 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2a668-d4db-4ebb-8b2d-86c1e7ec9f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:22.361570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a668-d4db-4ebb-8b2d-86c1e7ec9f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:22.361851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a668-d4db-4ebb-8b2d-86c1e7ec9f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:22.362123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a668-d4db-4ebb-8b2d-86c1e7ec9f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:22.363775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8db2a668-d4db-4ebb-8b2d-86c1e7ec9f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:22.475492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2a668-d4db-4ebb-8b2d-86c1e7ec9f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:22.476930 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2a668-d4db-4ebb-8b2d-86c1e7ec9f44 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:22.494943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 739/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:24.528253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6027-bfa7-4440-8889-d1061857e191 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:24.528820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6027-bfa7-4440-8889-d1061857e191 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:24.528820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6027-bfa7-4440-8889-d1061857e191 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:24.530180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:24.535510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e93a2-83dc-46bf-ace8-516c378510dd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:24.535923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e93a2-83dc-46bf-ace8-516c378510dd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:24.536068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e93a2-83dc-46bf-ace8-516c378510dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:24.601221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-168e93a2-83dc-46bf-ace8-516c378510dd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:24.602436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-168e93a2-83dc-46bf-ace8-516c378510dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:24.651131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:24.703460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:24.740970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6027-bfa7-4440-8889-d1061857e191 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:24.742483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-675d6027-bfa7-4440-8889-d1061857e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:24.846098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6027-bfa7-4440-8889-d1061857e191 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:24.893010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:24.919388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ddde4-9737-4785-a898-9d3b7b504654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:24.920008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ddde4-9737-4785-a898-9d3b7b504654 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:24.920285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ddde4-9737-4785-a898-9d3b7b504654 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:24.920548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ddde4-9737-4785-a898-9d3b7b504654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:24.922173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ac3ddde4-9737-4785-a898-9d3b7b504654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:25.028590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ddde4-9737-4785-a898-9d3b7b504654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:25.030023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ddde4-9737-4785-a898-9d3b7b504654 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:25.047899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 730/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:34.701572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=22 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:35.045631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=66 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:44.768692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6344-7ba8-4bf4-933a-bc6c57863c8a None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:44.769239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6344-7ba8-4bf4-933a-bc6c57863c8a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:44.769239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6344-7ba8-4bf4-933a-bc6c57863c8a None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:44.770710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 741/1471] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:44.775836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42c5a-6b4b-4c74-b631-59c0f971fd49 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:44.776288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42c5a-6b4b-4c74-b631-59c0f971fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:44.776401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42c5a-6b4b-4c74-b631-59c0f971fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:44.841048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a9f42c5a-6b4b-4c74-b631-59c0f971fd49 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:44.842336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a9f42c5a-6b4b-4c74-b631-59c0f971fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:44.937032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 731/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:45.020566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1959-4b3d-4b60-badf-38d71b98fff3 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:45.020797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1959-4b3d-4b60-badf-38d71b98fff3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:45.021072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1959-4b3d-4b60-badf-38d71b98fff3 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:45.022466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 742/1473] 10.222.0.20 () {54 vars in 966 bytes} [Sun Jul 31 18:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:45.028201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1230b-8084-4b6a-bafb-7e2f68f97e33 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:45.028494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1230b-8084-4b6a-bafb-7e2f68f97e33 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:45.028776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1230b-8084-4b6a-bafb-7e2f68f97e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:45.104850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-74a1230b-8084-4b6a-bafb-7e2f68f97e33 None None] MFA Rules not processed for user `2f49e424f08d40c5880a8ce3ca1cac59`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:45.106060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-74a1230b-8084-4b6a-bafb-7e2f68f97e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:45.126337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:45.183594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 732/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Jul 31 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:45.191428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1959-4b3d-4b60-badf-38d71b98fff3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:45.192954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b3be1959-4b3d-4b60-badf-38d71b98fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:45.295859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1959-4b3d-4b60-badf-38d71b98fff3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:45.368162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9618a7-770a-4104-97ba-6c026911e586 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:45.368831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9618a7-770a-4104-97ba-6c026911e586 service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:45.369112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9618a7-770a-4104-97ba-6c026911e586 service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:45.369425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9618a7-770a-4104-97ba-6c026911e586 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:45.371086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ef9618a7-770a-4104-97ba-6c026911e586 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:45.429919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:45.489095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9618a7-770a-4104-97ba-6c026911e586 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:45.490557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9618a7-770a-4104-97ba-6c026911e586 service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:45.510532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 743/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:47.581521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26200d7d-5343-4741-b64a-a1dba9ee534e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:47.582081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26200d7d-5343-4741-b64a-a1dba9ee534e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:47.582183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26200d7d-5343-4741-b64a-a1dba9ee534e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:47.583617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 733/1476] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:47.589273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3c4a4-1b4d-4d1d-b0f5-0b434326b9db None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:47.589701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3c4a4-1b4d-4d1d-b0f5-0b434326b9db None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:47.589804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3c4a4-1b4d-4d1d-b0f5-0b434326b9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:47.656867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dcc3c4a4-1b4d-4d1d-b0f5-0b434326b9db None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:47.657979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dcc3c4a4-1b4d-4d1d-b0f5-0b434326b9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:47.752260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 744/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:47.776338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26200d7d-5343-4741-b64a-a1dba9ee534e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:47.777896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-26200d7d-5343-4741-b64a-a1dba9ee534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:47.900237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26200d7d-5343-4741-b64a-a1dba9ee534e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:47.948822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:47.993214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea01a4-89d2-4410-b7ea-223fc06b75f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:47.993962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea01a4-89d2-4410-b7ea-223fc06b75f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:47.994740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea01a4-89d2-4410-b7ea-223fc06b75f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:47.995061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea01a4-89d2-4410-b7ea-223fc06b75f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:47.995728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea01a4-89d2-4410-b7ea-223fc06b75f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:47.997522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-08ea01a4-89d2-4410-b7ea-223fc06b75f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:31:47.997522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:31:47.997522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:31:47.998661 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea01a4-89d2-4410-b7ea-223fc06b75f0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:48.017264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 734/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Jul 31 18:31:47 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:31:50.054351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d0be-3973-443e-9da9-a623f24ccb0d None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:50.054926 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d0be-3973-443e-9da9-a623f24ccb0d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:50.054926 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d0be-3973-443e-9da9-a623f24ccb0d None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:50.056296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 745/1479] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:50.061783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1d10-8e8d-4d58-864d-a5b8d669c435 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:50.062218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1d10-8e8d-4d58-864d-a5b8d669c435 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:50.062325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1d10-8e8d-4d58-864d-a5b8d669c435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:50.128462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-df1d1d10-8e8d-4d58-864d-a5b8d669c435 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:50.129683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-df1d1d10-8e8d-4d58-864d-a5b8d669c435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:50.226435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 735/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:50.269511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188d0be-3973-443e-9da9-a623f24ccb0d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:50.271092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2188d0be-3973-443e-9da9-a623f24ccb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:50.281826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:50.417597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188d0be-3973-443e-9da9-a623f24ccb0d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:50.497884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:50.531001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bc1c8-228c-4698-aa0f-90af7743f490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:50.531622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc1c8-228c-4698-aa0f-90af7743f490 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:50.531903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc1c8-228c-4698-aa0f-90af7743f490 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:50.532178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc1c8-228c-4698-aa0f-90af7743f490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:50.533803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5a3bc1c8-228c-4698-aa0f-90af7743f490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:50.623144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc1c8-228c-4698-aa0f-90af7743f490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:50.624865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc1c8-228c-4698-aa0f-90af7743f490 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:50.642688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 746/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:52.820545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df479f-6ba1-4401-a561-3614745c3f3a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:52.821088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df479f-6ba1-4401-a561-3614745c3f3a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:52.821088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df479f-6ba1-4401-a561-3614745c3f3a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:52.822717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 736/1482] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:52.827940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67162de-6967-4b33-bdb9-f7636d24c055 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:52.828398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67162de-6967-4b33-bdb9-f7636d24c055 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:52.828508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67162de-6967-4b33-bdb9-f7636d24c055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:52.893861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f67162de-6967-4b33-bdb9-f7636d24c055 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:52.895113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f67162de-6967-4b33-bdb9-f7636d24c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:52.941298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:52.992351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 747/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:53.029266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df479f-6ba1-4401-a561-3614745c3f3a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:53.030793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-92df479f-6ba1-4401-a561-3614745c3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:53.054143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:53.134531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df479f-6ba1-4401-a561-3614745c3f3a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:53.329220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720afdcc-e3ba-4128-960f-4190ea24900e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:53.329830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720afdcc-e3ba-4128-960f-4190ea24900e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:53.330108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720afdcc-e3ba-4128-960f-4190ea24900e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:53.330375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720afdcc-e3ba-4128-960f-4190ea24900e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:53.332012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-720afdcc-e3ba-4128-960f-4190ea24900e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:53.407269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:53.442915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720afdcc-e3ba-4128-960f-4190ea24900e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:53.444405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720afdcc-e3ba-4128-960f-4190ea24900e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:53.463400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 737/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:55.502532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7feaa6-36e1-4e52-a8c1-cd8398379d13 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:55.503426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7feaa6-36e1-4e52-a8c1-cd8398379d13 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:55.503705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7feaa6-36e1-4e52-a8c1-cd8398379d13 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:55.505064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 748/1485] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:55.511210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46625-9048-49d7-a964-62738349e565 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:55.511932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46625-9048-49d7-a964-62738349e565 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:55.512035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46625-9048-49d7-a964-62738349e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:55.576445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6af46625-9048-49d7-a964-62738349e565 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:55.577842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6af46625-9048-49d7-a964-62738349e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:55.672633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 738/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:55.711047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7feaa6-36e1-4e52-a8c1-cd8398379d13 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:55.712583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ea7feaa6-36e1-4e52-a8c1-cd8398379d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:55.818285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7feaa6-36e1-4e52-a8c1-cd8398379d13 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:55.890242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:55.892097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13fbeb-cb49-42da-b45d-1554cd5663ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:55.892783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13fbeb-cb49-42da-b45d-1554cd5663ae service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:55.893141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13fbeb-cb49-42da-b45d-1554cd5663ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:55.893620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13fbeb-cb49-42da-b45d-1554cd5663ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:55.895723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fb13fbeb-cb49-42da-b45d-1554cd5663ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:56.002768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13fbeb-cb49-42da-b45d-1554cd5663ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:56.004224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13fbeb-cb49-42da-b45d-1554cd5663ae service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:56.022401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 749/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:31:58.093971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506777b-cb60-4033-bea2-4ff3a76e8f94 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:58.094524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506777b-cb60-4033-bea2-4ff3a76e8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:58.094524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506777b-cb60-4033-bea2-4ff3a76e8f94 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:58.095954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 739/1488] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:31:58.101107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c43b37-c78a-4dc9-8a12-0504a398ce9d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:58.101537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c43b37-c78a-4dc9-8a12-0504a398ce9d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:58.101663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c43b37-c78a-4dc9-8a12-0504a398ce9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:58.169206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-84c43b37-c78a-4dc9-8a12-0504a398ce9d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:31:58.170405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-84c43b37-c78a-4dc9-8a12-0504a398ce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:58.220937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:58.264972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 750/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:31:58.305352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506777b-cb60-4033-bea2-4ff3a76e8f94 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:31:58.306924 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8506777b-cb60-4033-bea2-4ff3a76e8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:58.344331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:58.411615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506777b-cb60-4033-bea2-4ff3a76e8f94 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:31:58.486009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62bcf4-f159-4a1f-a6c4-b223f26d64e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:31:58.486552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bcf4-f159-4a1f-a6c4-b223f26d64e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:31:58.486829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bcf4-f159-4a1f-a6c4-b223f26d64e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:31:58.487135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bcf4-f159-4a1f-a6c4-b223f26d64e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:31:58.488762 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2b62bcf4-f159-4a1f-a6c4-b223f26d64e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:31:58.572054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:58.601410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bcf4-f159-4a1f-a6c4-b223f26d64e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:31:58.602845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bcf4-f159-4a1f-a6c4-b223f26d64e8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:31:58.622857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 740/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:32:00.828419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129bc5-c54b-4c43-b0e3-478e47eaa06f None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:32:00.828989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129bc5-c54b-4c43-b0e3-478e47eaa06f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:32:00.828989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129bc5-c54b-4c43-b0e3-478e47eaa06f None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:32:00.830366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 751/1491] 10.222.0.20 () {54 vars in 926 bytes} [Sun Jul 31 18:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:32:00.835417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58d81a-9391-4971-a551-c97cb79bc664 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:32:00.835838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58d81a-9391-4971-a551-c97cb79bc664 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:32:00.835942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58d81a-9391-4971-a551-c97cb79bc664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:32:00.901712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b58d81a-9391-4971-a551-c97cb79bc664 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:32:00.902916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b58d81a-9391-4971-a551-c97cb79bc664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:32:00.996173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 741/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Sun Jul 31 18:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:32:01.035744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80129bc5-c54b-4c43-b0e3-478e47eaa06f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:32:01.037341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-80129bc5-c54b-4c43-b0e3-478e47eaa06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:32:01.140342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80129bc5-c54b-4c43-b0e3-478e47eaa06f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:32:01.215717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99886c6f-570d-4481-b93f-c5f5ff3dc446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:32:01.216338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99886c6f-570d-4481-b93f-c5f5ff3dc446 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:32:01.216617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99886c6f-570d-4481-b93f-c5f5ff3dc446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:32:01.216884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99886c6f-570d-4481-b93f-c5f5ff3dc446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:32:01.218481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-99886c6f-570d-4481-b93f-c5f5ff3dc446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:32:01.227511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:32:01.327597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99886c6f-570d-4481-b93f-c5f5ff3dc446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:32:01.329041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99886c6f-570d-4481-b93f-c5f5ff3dc446 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:32:01.346821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 752/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:32:10.994318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=82 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:32:11.344526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=50 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:29.312253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:29.312871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:29.312871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:29.388289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:33:29.389490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:29.488904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 742/1494] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:33:29.497257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8d4a-99ae-451c-a9f0-565f0cbb584e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:29.497742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8d4a-99ae-451c-a9f0-565f0cbb584e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:29.497858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8d4a-99ae-451c-a9f0-565f0cbb584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:29.574390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2f7e8d4a-99ae-451c-a9f0-565f0cbb584e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:33:29.575554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2f7e8d4a-99ae-451c-a9f0-565f0cbb584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:29.669911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 753/1495] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:33:29.674678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:29.675873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:29.687490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde231a-975e-4a7b-b491-89bf52a4a8f6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:29.749002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:29.783792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:29.784400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:29.784676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:29.784946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:29.785622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:33:29.785921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:29.786947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:29.786947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:33:29.786947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:33:29.787826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:29.799098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 743/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:33:29.807390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8d4a-99ae-451c-a9f0-565f0cbb584e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:29.817181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8d4a-99ae-451c-a9f0-565f0cbb584e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:29.878564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:29.913759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:29.914392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:29.914673 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:29.914982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:29.915622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:29.918057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING py.warnings [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:29.918057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: warnings.warn(msg) Jul 31 18:33:29.918057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: Jul 31 18:33:29.919303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:29.973953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 754/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:33:29 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:33:29.978374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:29.980573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:30.013571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d323-6318-4810-be57-00a9e430019a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:30.105631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:30.106242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:30.106520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:30.106791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:30.107499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:30.108522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:30.108522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:33:30.108522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:33:30.109727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:30.152235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 744/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:33:29 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:33:30.156438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:30.157946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:30.219668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517b5c0-f759-436c-8a4c-f1c186825877 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:30.302803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:30.314585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:30.315248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:30.315528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:30.315798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:30.316481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:30.317525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING py.warnings [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:30.317525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: warnings.warn(msg) Jul 31 18:33:30.317525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: Jul 31 18:33:30.318403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:30.330671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 755/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:33:30.334637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:30.336182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:30.348039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95350c-31f2-4eeb-9f19-566d2507a126 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:30.372905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:30.443386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2af2a2-cfe0-4068-947f-0a22831e2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:30.444011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af2a2-cfe0-4068-947f-0a22831e2e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:30.444291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af2a2-cfe0-4068-947f-0a22831e2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:30.444569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af2a2-cfe0-4068-947f-0a22831e2e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:30.445261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2af2a2-cfe0-4068-947f-0a22831e2e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:30.446282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-8b2af2a2-cfe0-4068-947f-0a22831e2e61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:30.446282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:33:30.446282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:33:30.447199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2af2a2-cfe0-4068-947f-0a22831e2e61 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:30.460241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 745/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:33:30.464645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:30.466223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:30.499521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1217e-dd58-4bb5-aac5-7183e0d0fadc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:30.593155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591553a6-8108-4606-bca6-1881cf98477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:30.593815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591553a6-8108-4606-bca6-1881cf98477e admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:30.594090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591553a6-8108-4606-bca6-1881cf98477e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:30.594360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591553a6-8108-4606-bca6-1881cf98477e admin admin] PATH_INFO: `/v3/projects/c148b13f07d54193bf5890e5e25c9fce/users/07e47fee78ec4a489ebd50f43aa5cb50/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:30.615353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591553a6-8108-4606-bca6-1881cf98477e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c148b13f07d54193bf5890e5e25c9fce, user_id=07e47fee78ec4a489ebd50f43aa5cb50, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:30.616383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING py.warnings [None req-591553a6-8108-4606-bca6-1881cf98477e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:30.616383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: warnings.warn(msg) Jul 31 18:33:30.616383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: Jul 31 18:33:30.618324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591553a6-8108-4606-bca6-1881cf98477e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:30.642553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 756/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:33:30 2022] PUT /identity/v3/projects/c148b13f07d54193bf5890e5e25c9fce/users/07e47fee78ec4a489ebd50f43aa5cb50/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:33:30.655689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117e11-3b85-43d9-8d21-207e5010750e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:30.655980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117e11-3b85-43d9-8d21-207e5010750e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:30.656255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117e11-3b85-43d9-8d21-207e5010750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:30.713069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dc117e11-3b85-43d9-8d21-207e5010750e None None] MFA Rules not processed for user `07e47fee78ec4a489ebd50f43aa5cb50`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:33:30.714901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dc117e11-3b85-43d9-8d21-207e5010750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:30.792658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 746/1502] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:33:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:33:30.805525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99708-aa4c-412d-8773-e48908bc71d1 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:30.805807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99708-aa4c-412d-8773-e48908bc71d1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:30.806078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99708-aa4c-412d-8773-e48908bc71d1 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:30.807455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 757/1503] 10.222.0.20 () {54 vars in 964 bytes} [Sun Jul 31 18:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:33:30.812441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039f450-b77e-42e7-84a3-40944dcd609b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:30.812726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039f450-b77e-42e7-84a3-40944dcd609b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:30.812999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039f450-b77e-42e7-84a3-40944dcd609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:30.844429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:30.889868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d039f450-b77e-42e7-84a3-40944dcd609b None None] MFA Rules not processed for user `b9970bd7f09446339fb291e591cdfbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:33:30.891360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d039f450-b77e-42e7-84a3-40944dcd609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:30.966084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 747/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Jul 31 18:33:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:33:30.973727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99708-aa4c-412d-8773-e48908bc71d1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:30.975271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-22c99708-aa4c-412d-8773-e48908bc71d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:31.024909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:31.079209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99708-aa4c-412d-8773-e48908bc71d1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:31.152461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:31.153080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:31.153359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:31.153631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:31.155289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:31.255675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:31.257112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:31.260561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:31.275845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 758/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:33:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:33:31.326247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9366e5f-39e2-46b4-be1f-52fda58a4d0b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:31.326536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9366e5f-39e2-46b4-be1f-52fda58a4d0b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:31.326812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9366e5f-39e2-46b4-be1f-52fda58a4d0b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:31.328129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 748/1506] 10.222.0.20 () {52 vars in 830 bytes} [Sun Jul 31 18:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:33:31.331832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:31.333042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:31.430013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb494c9a-44ac-4fc9-af82-4f340688958d service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:31.523664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:31.524306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:31.524491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:31.524760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] PATH_INFO: `/v3/users/07e47fee78ec4a489ebd50f43aa5cb50` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:31.537321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e47fee78ec4a489ebd50f43aa5cb50)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:31.538342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING py.warnings [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:31.538342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: warnings.warn(msg) Jul 31 18:33:31.538342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: Jul 31 18:33:31.539573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:31.548942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:31.609130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e47fee78ec4a489ebd50f43aa5cb50'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:31.623475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e47fee78ec4a489ebd50f43aa5cb50'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:31.623927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e47fee78ec4a489ebd50f43aa5cb50'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:31.632797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e47fee78ec4a489ebd50f43aa5cb50'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:31.657836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e47fee78ec4a489ebd50f43aa5cb50'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:31.663428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 759/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:33:31 2022] DELETE /identity/v3/users/07e47fee78ec4a489ebd50f43aa5cb50 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:33:31.668108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:31.668607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:31.668711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:31.724526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:33:31.725729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:31.801282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:31.814841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 749/1508] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:33:31.824377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:31.825592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:31.924624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4046-678c-4b6a-b4c6-faa307caeae0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:31.978888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:31.999463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04793-9a0c-4025-84cf-1cff92f7dd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:32.000090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04793-9a0c-4025-84cf-1cff92f7dd3d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:32.000362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04793-9a0c-4025-84cf-1cff92f7dd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:32.000626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04793-9a0c-4025-84cf-1cff92f7dd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:32.002261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a8b04793-9a0c-4025-84cf-1cff92f7dd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:32.110302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04793-9a0c-4025-84cf-1cff92f7dd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:32.111687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04793-9a0c-4025-84cf-1cff92f7dd3d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:32.130125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 760/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:33:32.487193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:33:32.488453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:33:32.500755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35880-e13d-440c-bd60-e0fb01ba2db2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:33:32.596586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:33:32.597232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:33:32.597504 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:33:32.597769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] PATH_INFO: `/v3/projects/c148b13f07d54193bf5890e5e25c9fce` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:33:32.608129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c148b13f07d54193bf5890e5e25c9fce)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:33:32.609158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:33:32.609158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:33:32.609158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:33:32.610354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:33:32.668040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c148b13f07d54193bf5890e5e25c9fce', 'request_id': 'req-72436e74-a58f-4b3a-862e-f2060f0ae514'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:32.680724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c148b13f07d54193bf5890e5e25c9fce', 'request_id': 'req-72436e74-a58f-4b3a-862e-f2060f0ae514'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:32.686713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c148b13f07d54193bf5890e5e25c9fce', 'request_id': 'req-72436e74-a58f-4b3a-862e-f2060f0ae514'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:32.719941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] The token cache is being invalidate because project c148b13f07d54193bf5890e5e25c9fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:33:32.720231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:32.720812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72436e74-a58f-4b3a-862e-f2060f0ae514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:33:32.722132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 750/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:33:32 2022] DELETE /identity/v3/projects/c148b13f07d54193bf5890e5e25c9fce => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:33:42.127911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=62 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:33:42.717801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:15.735551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fad5a-2311-4e77-9b6a-63b25e239e44 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:15.736125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fad5a-2311-4e77-9b6a-63b25e239e44 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:15.736125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fad5a-2311-4e77-9b6a-63b25e239e44 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:15.737382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:15.742251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f11a8-8283-4a09-9064-88a6cbff1319 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:15.742654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f11a8-8283-4a09-9064-88a6cbff1319 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:15.742810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f11a8-8283-4a09-9064-88a6cbff1319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:15.822516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-641f11a8-8283-4a09-9064-88a6cbff1319 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:15.823784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-641f11a8-8283-4a09-9064-88a6cbff1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:15.930904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:16.089246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fad5a-2311-4e77-9b6a-63b25e239e44 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:16.091579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-164fad5a-2311-4e77-9b6a-63b25e239e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:16.211183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fad5a-2311-4e77-9b6a-63b25e239e44 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:16.216906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe2b4f-3bdb-4ecc-b935-37b77240be8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:16.217521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2b4f-3bdb-4ecc-b935-37b77240be8a service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:16.217802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2b4f-3bdb-4ecc-b935-37b77240be8a service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:16.218083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2b4f-3bdb-4ecc-b935-37b77240be8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:16.226028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe2b4f-3bdb-4ecc-b935-37b77240be8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:16.227645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe2b4f-3bdb-4ecc-b935-37b77240be8a service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:16.237161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 762/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:17.095577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b491-e19f-4031-b693-4c992add6f9c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:17.096150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b491-e19f-4031-b693-4c992add6f9c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:17.096150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b491-e19f-4031-b693-4c992add6f9c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:17.097525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:17.102223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e549-76bf-4e99-8ba4-871f0e8b2840 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:17.102670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e549-76bf-4e99-8ba4-871f0e8b2840 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:17.102777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e549-76bf-4e99-8ba4-871f0e8b2840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:17.122484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-45e9e549-76bf-4e99-8ba4-871f0e8b2840 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:17.123714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-45e9e549-76bf-4e99-8ba4-871f0e8b2840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:17.131561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:17.286473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b491-e19f-4031-b693-4c992add6f9c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:17.301861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b491-e19f-4031-b693-4c992add6f9c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:17.307290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008fae-93a3-4a82-9f65-da7876753ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:17.307901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008fae-93a3-4a82-9f65-da7876753ff7 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:17.308726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008fae-93a3-4a82-9f65-da7876753ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:17.309217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008fae-93a3-4a82-9f65-da7876753ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:17.317403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008fae-93a3-4a82-9f65-da7876753ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:17.319029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008fae-93a3-4a82-9f65-da7876753ff7 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:17.328675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 753/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:17.720110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d443c81-f831-451c-bf18-29c4d7598977 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:17.720323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d443c81-f831-451c-bf18-29c4d7598977 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:17.720577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d443c81-f831-451c-bf18-29c4d7598977 None None] PATH_INFO: `/v3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:17.721876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 764/1517] 10.222.0.17 () {54 vars in 925 bytes} [Sun Jul 31 18:35:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:35:17.729946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630e1d-7e2a-4733-a056-1361549cff9d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:17.730921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630e1d-7e2a-4733-a056-1361549cff9d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:17.731229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630e1d-7e2a-4733-a056-1361549cff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:17.790155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d9630e1d-7e2a-4733-a056-1361549cff9d None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:17.791399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9630e1d-7e2a-4733-a056-1361549cff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:17.808968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:17.867459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 754/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Sun Jul 31 18:35:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:21.635845 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9fd16-f74d-4ec5-9ac4-97e16ce7cdf6 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:21.636419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9fd16-f74d-4ec5-9ac4-97e16ce7cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:21.636419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9fd16-f74d-4ec5-9ac4-97e16ce7cdf6 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:21.637905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 765/1519] 10.222.0.20 () {54 vars in 961 bytes} [Sun Jul 31 18:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:21.642888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5583c65-aa9c-4d2d-bb5f-545b85457ce5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:21.643341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5583c65-aa9c-4d2d-bb5f-545b85457ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:21.643454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5583c65-aa9c-4d2d-bb5f-545b85457ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:21.662750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e5583c65-aa9c-4d2d-bb5f-545b85457ce5 None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:21.663957 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5583c65-aa9c-4d2d-bb5f-545b85457ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:21.673026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 755/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Jul 31 18:35:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:21.680323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9fd16-f74d-4ec5-9ac4-97e16ce7cdf6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:21.694608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9fd16-f74d-4ec5-9ac4-97e16ce7cdf6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:21.699811 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6c0de-48d7-42fa-b444-c3ef57219e3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:21.700435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c0de-48d7-42fa-b444-c3ef57219e3e service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:21.700719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c0de-48d7-42fa-b444-c3ef57219e3e service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:21.700995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c0de-48d7-42fa-b444-c3ef57219e3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:21.709213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6c0de-48d7-42fa-b444-c3ef57219e3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:21.710784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6c0de-48d7-42fa-b444-c3ef57219e3e service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:21.720366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 766/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:35:28.561345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ed3d-9a74-43af-b9ce-c14d6f59f1be None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:28.563223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ed3d-9a74-43af-b9ce-c14d6f59f1be None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:28.563223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ed3d-9a74-43af-b9ce-c14d6f59f1be None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:28.563417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:28.568268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446650-39fe-4853-965e-5e77639a2776 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:28.568692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446650-39fe-4853-965e-5e77639a2776 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:28.568847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446650-39fe-4853-965e-5e77639a2776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:28.587784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-96446650-39fe-4853-965e-5e77639a2776 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:28.588969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-96446650-39fe-4853-965e-5e77639a2776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:28.597190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:28.751104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ed3d-9a74-43af-b9ce-c14d6f59f1be None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:28.765455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ed3d-9a74-43af-b9ce-c14d6f59f1be None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:28.771142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f81fc5-a2f8-49ba-9db7-42d59673bb9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:28.771751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81fc5-a2f8-49ba-9db7-42d59673bb9f service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:28.772032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81fc5-a2f8-49ba-9db7-42d59673bb9f service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:28.772307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81fc5-a2f8-49ba-9db7-42d59673bb9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:28.780905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81fc5-a2f8-49ba-9db7-42d59673bb9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:28.782526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81fc5-a2f8-49ba-9db7-42d59673bb9f service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:28.791802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 757/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:29.622695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30bab-6995-4202-af92-e956d888a864 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:29.623282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30bab-6995-4202-af92-e956d888a864 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:29.623282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30bab-6995-4202-af92-e956d888a864 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:29.624679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 18:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:29.629570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0aa91-c559-41aa-ad0f-6cff95c363c1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:29.629998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0aa91-c559-41aa-ad0f-6cff95c363c1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:29.630149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0aa91-c559-41aa-ad0f-6cff95c363c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:29.651158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b5d0aa91-c559-41aa-ad0f-6cff95c363c1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:29.653377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5d0aa91-c559-41aa-ad0f-6cff95c363c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:29.661200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 18:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:29.819167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e30bab-6995-4202-af92-e956d888a864 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:29.834165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e30bab-6995-4202-af92-e956d888a864 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:29.840464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9328ffe-6b30-44c4-8200-a4e639e139c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:29.841072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9328ffe-6b30-44c4-8200-a4e639e139c0 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:29.841351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9328ffe-6b30-44c4-8200-a4e639e139c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:29.841624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9328ffe-6b30-44c4-8200-a4e639e139c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:29.849972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9328ffe-6b30-44c4-8200-a4e639e139c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:29.851628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9328ffe-6b30-44c4-8200-a4e639e139c0 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:29.861625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 769/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:33.726840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b83c12-3f99-4ad8-8270-66404bca0b31 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:33.727395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b83c12-3f99-4ad8-8270-66404bca0b31 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:33.727395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b83c12-3f99-4ad8-8270-66404bca0b31 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:33.728707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:33.734438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44304aa-a958-4e39-8697-c114a18a3fc3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:33.734861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44304aa-a958-4e39-8697-c114a18a3fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:33.735001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44304aa-a958-4e39-8697-c114a18a3fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:33.754828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f44304aa-a958-4e39-8697-c114a18a3fc3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:33.756059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f44304aa-a958-4e39-8697-c114a18a3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:33.763976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:33.837585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b83c12-3f99-4ad8-8270-66404bca0b31 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:33.839276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-22b83c12-3f99-4ad8-8270-66404bca0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:33.917026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b83c12-3f99-4ad8-8270-66404bca0b31 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:33.921396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692123-833a-46de-8870-19284bfabb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:33.922010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692123-833a-46de-8870-19284bfabb78 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:33.922291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692123-833a-46de-8870-19284bfabb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:33.922563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692123-833a-46de-8870-19284bfabb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:33.931452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692123-833a-46de-8870-19284bfabb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:33.933584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692123-833a-46de-8870-19284bfabb78 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:33.943106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 760/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:35.922311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd783-ff9b-4975-bba7-4cbc9a205518 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:35.922884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd783-ff9b-4975-bba7-4cbc9a205518 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:35.922884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd783-ff9b-4975-bba7-4cbc9a205518 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:35.924230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:35.929373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbd26-e758-469c-a337-2a06286c02c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:35.929822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbd26-e758-469c-a337-2a06286c02c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:35.929941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbd26-e758-469c-a337-2a06286c02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:35.949844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-998fbd26-e758-469c-a337-2a06286c02c3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:35.951074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-998fbd26-e758-469c-a337-2a06286c02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:35.958788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:35.994475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dd783-ff9b-4975-bba7-4cbc9a205518 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:36.006134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dd783-ff9b-4975-bba7-4cbc9a205518 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:36.009650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff25c-7576-4910-90d8-f9e0a07a609c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:36.010259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff25c-7576-4910-90d8-f9e0a07a609c service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:36.010537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff25c-7576-4910-90d8-f9e0a07a609c service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:36.010874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff25c-7576-4910-90d8-f9e0a07a609c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:36.023124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff25c-7576-4910-90d8-f9e0a07a609c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:36.024553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff25c-7576-4910-90d8-f9e0a07a609c service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:36.034315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 772/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:39.483951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bba79-91c2-42d8-99c2-ea84c25ce33e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:39.484508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bba79-91c2-42d8-99c2-ea84c25ce33e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:39.484508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bba79-91c2-42d8-99c2-ea84c25ce33e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:39.485867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:39.490951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91220-c821-4451-b0eb-0b52a7048ca8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:39.491380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91220-c821-4451-b0eb-0b52a7048ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:39.491534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91220-c821-4451-b0eb-0b52a7048ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:39.511848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-07d91220-c821-4451-b0eb-0b52a7048ca8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:39.513046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-07d91220-c821-4451-b0eb-0b52a7048ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:39.521371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:39.828822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bba79-91c2-42d8-99c2-ea84c25ce33e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:39.830522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-661bba79-91c2-42d8-99c2-ea84c25ce33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:39.894396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:39.908519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bba79-91c2-42d8-99c2-ea84c25ce33e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:39.912075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c357f-d6e6-4923-ad3e-cb7c0a95e89e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:39.912690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c357f-d6e6-4923-ad3e-cb7c0a95e89e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:39.912968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c357f-d6e6-4923-ad3e-cb7c0a95e89e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:39.913241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c357f-d6e6-4923-ad3e-cb7c0a95e89e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:39.922204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c357f-d6e6-4923-ad3e-cb7c0a95e89e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:39.924277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c357f-d6e6-4923-ad3e-cb7c0a95e89e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:39.934383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 763/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:41.958429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91013ceb-978d-488a-8b69-f51a7fddfa05 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:41.959026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91013ceb-978d-488a-8b69-f51a7fddfa05 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:41.959026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91013ceb-978d-488a-8b69-f51a7fddfa05 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:41.960390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 18:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:35:41.965711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e06d-e1b4-41d0-ada9-29e6ac68697b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:41.966143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e06d-e1b4-41d0-ada9-29e6ac68697b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:41.966275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e06d-e1b4-41d0-ada9-29e6ac68697b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:41.985935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-93c5e06d-e1b4-41d0-ada9-29e6ac68697b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:35:41.987175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-93c5e06d-e1b4-41d0-ada9-29e6ac68697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:41.994960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 18:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:35:42.316332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91013ceb-978d-488a-8b69-f51a7fddfa05 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:35:42.318041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-91013ceb-978d-488a-8b69-f51a7fddfa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:35:42.326173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=84 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:42.332411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91013ceb-978d-488a-8b69-f51a7fddfa05 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:35:42.335938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66c958-9c64-4574-9447-cbaf48a5a6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:35:42.336549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c958-9c64-4574-9447-cbaf48a5a6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:35:42.336821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c958-9c64-4574-9447-cbaf48a5a6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:35:42.337098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c958-9c64-4574-9447-cbaf48a5a6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:35:42.345973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66c958-9c64-4574-9447-cbaf48a5a6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:35:42.347439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66c958-9c64-4574-9447-cbaf48a5a6e8 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:35:42.356817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 775/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:35:51.981793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=11 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:52.352562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:14.376341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf854e-0b67-4966-bf2f-13021f24495f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.380663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf854e-0b67-4966-bf2f-13021f24495f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.380663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf854e-0b67-4966-bf2f-13021f24495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.403694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-23bf854e-0b67-4966-bf2f-13021f24495f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.406245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-23bf854e-0b67-4966-bf2f-13021f24495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.413902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010420-6975-4d16-85cc-6733cbf89fde None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.414906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010420-6975-4d16-85cc-6733cbf89fde None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.415450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010420-6975-4d16-85cc-6733cbf89fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.417523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 765/1540] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.427564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6ecf-4c42-4de5-894d-200e399ac0fb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.427860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6ecf-4c42-4de5-894d-200e399ac0fb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.428124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6ecf-4c42-4de5-894d-200e399ac0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.447270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5b010420-6975-4d16-85cc-6733cbf89fde None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.448550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5b010420-6975-4d16-85cc-6733cbf89fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.459116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b9be6ecf-4c42-4de5-894d-200e399ac0fb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.460322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9be6ecf-4c42-4de5-894d-200e399ac0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.472452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 776/1541] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:37:14.473921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 766/1542] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.478653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b010420-6975-4d16-85cc-6733cbf89fde None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:14.487970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d4184-e146-4bc8-8da5-f24ff9e78d76 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.488261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d4184-e146-4bc8-8da5-f24ff9e78d76 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.488544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d4184-e146-4bc8-8da5-f24ff9e78d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.493763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b010420-6975-4d16-85cc-6733cbf89fde None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:14.506053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:14.507108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.507618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.508126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.509036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:14.509553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:14.514964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING py.warnings [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:37:14.514964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: warnings.warn(msg) Jul 31 18:37:14.514964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: Jul 31 18:37:14.516466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be154dfd-e0fb-4a70-8e8d-e6018017bf98 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:14.518593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9f3d4184-e146-4bc8-8da5-f24ff9e78d76 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.520092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f3d4184-e146-4bc8-8da5-f24ff9e78d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.534610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 777/1543] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:14.539803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb38db1-307c-47f6-b237-67389466621a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.540372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb38db1-307c-47f6-b237-67389466621a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.540870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb38db1-307c-47f6-b237-67389466621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.552874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 767/1544] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.552874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d4184-e146-4bc8-8da5-f24ff9e78d76 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:14.568247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d4184-e146-4bc8-8da5-f24ff9e78d76 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:14.574263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4eb38db1-307c-47f6-b237-67389466621a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.576203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4eb38db1-307c-47f6-b237-67389466621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.580430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf772d6-5a29-4fa3-b4ee-2e29c86765d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:14.581381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf772d6-5a29-4fa3-b4ee-2e29c86765d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.581877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf772d6-5a29-4fa3-b4ee-2e29c86765d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.582370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf772d6-5a29-4fa3-b4ee-2e29c86765d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.583276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf772d6-5a29-4fa3-b4ee-2e29c86765d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:14.585485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-dbf772d6-5a29-4fa3-b4ee-2e29c86765d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:37:14.585485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:37:14.585485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:37:14.587980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf772d6-5a29-4fa3-b4ee-2e29c86765d0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:14.603264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 778/1545] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.605031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb7f50-7612-427c-8dbc-819f00820117 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.605540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb7f50-7612-427c-8dbc-819f00820117 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.606035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb7f50-7612-427c-8dbc-819f00820117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.638014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-80eb7f50-7612-427c-8dbc-819f00820117 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.639805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-80eb7f50-7612-427c-8dbc-819f00820117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.649900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 779/1546] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.650713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb7f50-7612-427c-8dbc-819f00820117 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:14.653650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 768/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:14.656348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4324e-7157-4db0-97b2-c477062a98d0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.656914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4324e-7157-4db0-97b2-c477062a98d0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.657413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4324e-7157-4db0-97b2-c477062a98d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.662267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb7f50-7612-427c-8dbc-819f00820117 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:14.679812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-50f4324e-7157-4db0-97b2-c477062a98d0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.681236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-50f4324e-7157-4db0-97b2-c477062a98d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.728526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00a31-475e-4b0d-966d-1a7b622a2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:14.729628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00a31-475e-4b0d-966d-1a7b622a2398 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.730074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00a31-475e-4b0d-966d-1a7b622a2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.730507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00a31-475e-4b0d-966d-1a7b622a2398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.731391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b00a31-475e-4b0d-966d-1a7b622a2398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:14.731869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b00a31-475e-4b0d-966d-1a7b622a2398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:14.734392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b00a31-475e-4b0d-966d-1a7b622a2398 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:14.746508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 780/1548] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:14.748026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f832c-11b9-47b4-aef2-826c30eff681 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.748310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f832c-11b9-47b4-aef2-826c30eff681 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.748585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f832c-11b9-47b4-aef2-826c30eff681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.764936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 769/1549] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.766412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40bcd9-d7c0-4a1c-8ff1-4002abc52b6a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.766703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40bcd9-d7c0-4a1c-8ff1-4002abc52b6a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.767009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40bcd9-d7c0-4a1c-8ff1-4002abc52b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.775188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ce7f832c-11b9-47b4-aef2-826c30eff681 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.776383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ce7f832c-11b9-47b4-aef2-826c30eff681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.784264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 781/1550] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.785082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f832c-11b9-47b4-aef2-826c30eff681 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:14.786337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8f40bcd9-d7c0-4a1c-8ff1-4002abc52b6a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.787554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8f40bcd9-d7c0-4a1c-8ff1-4002abc52b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.794994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f832c-11b9-47b4-aef2-826c30eff681 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:14.796693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 770/1551] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.797901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ea378-485d-49df-83a6-b14507e44ee7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.798189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ea378-485d-49df-83a6-b14507e44ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.798463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ea378-485d-49df-83a6-b14507e44ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.805292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:14.805913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.806188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.806587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.807288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:14.808304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING py.warnings [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:37:14.808304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: warnings.warn(msg) Jul 31 18:37:14.808304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: Jul 31 18:37:14.809496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:14.819179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d98ea378-485d-49df-83a6-b14507e44ee7 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.820393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d98ea378-485d-49df-83a6-b14507e44ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.829899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 771/1552] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.836111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 782/1553] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/users => generated 278 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:14.836111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:14.836360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26d39-2155-411d-b52e-c543f9608344 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.836360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26d39-2155-411d-b52e-c543f9608344 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.836360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26d39-2155-411d-b52e-c543f9608344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.843795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05634ac7-6013-4f8a-99a9-59785c5879c3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:14.848626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:14.849246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.849570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.849851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.850508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:14.852490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:14.854162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-abc26d39-2155-411d-b52e-c543f9608344 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.855394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-abc26d39-2155-411d-b52e-c543f9608344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.864702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 772/1554] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.872983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b40ce-c827-47bf-93be-3ab0a6def92a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.873345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b40ce-c827-47bf-93be-3ab0a6def92a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.873624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b40ce-c827-47bf-93be-3ab0a6def92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.882345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 783/1555] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:14.883165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:14.895343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-455b40ce-c827-47bf-93be-3ab0a6def92a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.896476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-455b40ce-c827-47bf-93be-3ab0a6def92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.945396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb471c5-4bcb-452d-8f9c-63e1d9646efd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:14.950216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748ec1-db00-4940-a54b-5d2acb19426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:14.950854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748ec1-db00-4940-a54b-5d2acb19426a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.951258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748ec1-db00-4940-a54b-5d2acb19426a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.951537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748ec1-db00-4940-a54b-5d2acb19426a admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.952432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748ec1-db00-4940-a54b-5d2acb19426a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:14.952737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748ec1-db00-4940-a54b-5d2acb19426a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:14.954343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748ec1-db00-4940-a54b-5d2acb19426a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:14.956266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 773/1556] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.957559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026eb0-0c15-4d6e-bf69-06c75577150f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.957847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026eb0-0c15-4d6e-bf69-06c75577150f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.958129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026eb0-0c15-4d6e-bf69-06c75577150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.969613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 784/1557] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:14.970696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bbb03-d3b3-4432-8587-5795ff63ab33 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:14.971027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bbb03-d3b3-4432-8587-5795ff63ab33 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:14.971308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bbb03-d3b3-4432-8587-5795ff63ab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:14.977624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-80026eb0-0c15-4d6e-bf69-06c75577150f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.978838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-80026eb0-0c15-4d6e-bf69-06c75577150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.987593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 774/1558] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:14.988379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026eb0-0c15-4d6e-bf69-06c75577150f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:14.991388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4a6bbb03-d3b3-4432-8587-5795ff63ab33 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:14.992592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4a6bbb03-d3b3-4432-8587-5795ff63ab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:14.997756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026eb0-0c15-4d6e-bf69-06c75577150f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.001430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 785/1559] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:15.002278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bbb03-d3b3-4432-8587-5795ff63ab33 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.003301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708be26d-518d-4e91-a931-b36dfc3eee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.003922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be26d-518d-4e91-a931-b36dfc3eee4a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.004204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be26d-518d-4e91-a931-b36dfc3eee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.004608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be26d-518d-4e91-a931-b36dfc3eee4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.005315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708be26d-518d-4e91-a931-b36dfc3eee4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:15.005620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708be26d-518d-4e91-a931-b36dfc3eee4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.006820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:15.007263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708be26d-518d-4e91-a931-b36dfc3eee4a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.013761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bbb03-d3b3-4432-8587-5795ff63ab33 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.019957 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 775/1560] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:15.020796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.021032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc58bbb-75de-459f-9974-148d2267ffde None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.021303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc58bbb-75de-459f-9974-148d2267ffde None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.021416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.021573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc58bbb-75de-459f-9974-148d2267ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.021678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.021949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.022647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.024312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.036528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 786/1561] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:15.037208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.040486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fcc58bbb-75de-459f-9974-148d2267ffde None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:15.041689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fcc58bbb-75de-459f-9974-148d2267ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:15.048168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575900e-0e51-49ee-8c97-e7d291e58404 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.050501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 776/1562] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:15.051747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29b07-d2ff-46e0-8cef-2be2fb17cf26 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.052036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29b07-d2ff-46e0-8cef-2be2fb17cf26 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.052308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29b07-d2ff-46e0-8cef-2be2fb17cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.052813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.053413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.053738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.054265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.054923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.056853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.060719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:15.073340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-62c29b07-d2ff-46e0-8cef-2be2fb17cf26 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:15.074633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-62c29b07-d2ff-46e0-8cef-2be2fb17cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:15.079840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 787/1563] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.080640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.086774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 777/1564] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:15.087719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29b07-d2ff-46e0-8cef-2be2fb17cf26 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.091659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b168-02ba-4d25-a7ee-1be9b7d37320 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.097185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.097797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.098035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29b07-d2ff-46e0-8cef-2be2fb17cf26 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.098181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.098358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.099051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.100976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.102548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.103188 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.103472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.103749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.104435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:15.104738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.106327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.118714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 778/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:15.126866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.130132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 788/1566] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.131155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.137001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1a43-e1d0-4637-9ef8-6c3e82ab6f47 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.194696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.195254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047b9c8-dc9d-485e-bc89-19dba3d93890 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.195368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.195630 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.195906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.196599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:15.196908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.198527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.200098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.200710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.200990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.201256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.202000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.204147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.210752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 779/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:15.211594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.222437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad60bf-3d4e-4290-aaa4-6ed5f7c59384 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.227784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.228434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.228716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.228995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.229687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.231413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.236885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 789/1568] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.236885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.242376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 780/1569] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:15.245600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.252783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605e63e-5913-4991-86e7-8dc1c2d09103 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.297417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f808-0f89-44d1-ae13-e0c0092a380f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.302149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.302769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.303080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.303362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.304069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:15.304372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.305978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.309016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.309661 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.309937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.310488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.311760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.313426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.325702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 790/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:15.325702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.325988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 781/1571] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:15.325988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.331416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f927881-b068-447f-a72d-72720a966df2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.335463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58d87-df6c-4722-84bd-5a13f167b905 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.336111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.336762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.337039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.337307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.338021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:15.338322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.339998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.340146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.340670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.340953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.341229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.341881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.344329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.353164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 791/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:15.353949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.363687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95d77-1aca-450d-bdba-3802eacffab7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.368578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.369180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.369457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.369724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.370368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.372291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.376738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 782/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.376738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.390561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:15.399109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 792/1574] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.400007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.410414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e883-d330-42bf-8511-1230e1bb12f1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.422290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:15.445415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a000f0-52af-42ed-a735-795a85ae551b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.449979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.450620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.450897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.451463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.451968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.453894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.467979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.468862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.468862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.469121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.469775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.471871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.484594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 783/1575] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.485615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.494795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 793/1576] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.495896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.505279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca947e-02dc-440a-b42f-4bf16679927a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.553604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d934ad-7245-4a1b-9171-367a1b0d6c2a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.558717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.559428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.559693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.559962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] PATH_INFO: `/v3/projects/cb4cee9734bb49668a3129f6a55a7bfe/users/11d41e8f708645c08a586d8b6d2d8c35/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.565196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.566401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.566749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.567054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.567718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.569628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.575355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4cee9734bb49668a3129f6a55a7bfe, user_id=11d41e8f708645c08a586d8b6d2d8c35, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.576514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:37:15.576514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:37:15.576514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:37:15.579607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.594640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 784/1577] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:15 2022] PUT /identity/v3/projects/cb4cee9734bb49668a3129f6a55a7bfe/users/11d41e8f708645c08a586d8b6d2d8c35/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:15.595670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.598493 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 794/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.599207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.658245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fdb87-54ad-445e-a826-6222c8e7180b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.662857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.663513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.663799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.664078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.664772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.666378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9293c38-b735-4bdc-aecd-d3d6b1f30fec admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.666503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.672204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.672823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.673099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.673368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.674021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.675954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.680090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 785/1579] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:15.680090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.687237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b40c-6d8c-4200-87d2-b0f1cebb3422 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.691838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.692500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.692850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.693176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.693975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.696255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.696718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:15.704534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 795/1580] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.705402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.723983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 786/1581] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.723983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.731516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335ede-94ea-42dd-9040-299f9656ec1a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.758176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:15.770001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983b678-97da-49fa-aee4-717010d229f9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.774712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.775367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.775646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.775948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.776639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.778257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.788292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 796/1582] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:15.788907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.792829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.793459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.793894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.794172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.794853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.797465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.799001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1ecc8-cb99-4c81-8b96-40bc1bbde884 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.803583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328000d7-2206-4575-8dae-cfa25176de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.804179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328000d7-2206-4575-8dae-cfa25176de8d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.804468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328000d7-2206-4575-8dae-cfa25176de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.804746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328000d7-2206-4575-8dae-cfa25176de8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.805428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328000d7-2206-4575-8dae-cfa25176de8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.807044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328000d7-2206-4575-8dae-cfa25176de8d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.818419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 787/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.819118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 797/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:15.819248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.820163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5885-01c2-4099-8366-eeee39e32e7d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.820455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5885-01c2-4099-8366-eeee39e32e7d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.820733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5885-01c2-4099-8366-eeee39e32e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.834520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9237e84-22a5-4f5f-83f7-49a4cedad6e9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.839157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.839802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.840081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.840351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.841001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.843566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.851554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-066a5885-01c2-4099-8366-eeee39e32e7d None None] MFA Rules not processed for user `11d41e8f708645c08a586d8b6d2d8c35`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:15.852775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-066a5885-01c2-4099-8366-eeee39e32e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:15.869556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 788/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:15.869556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.877495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86550e4d-2e7a-4f1f-b790-b7e1ae9b0741 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.882075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.882712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.883020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.883295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] PATH_INFO: `/v3/projects/d945d63cd94e49ba8ee55e748348fe5f/users/6bf98efd067843fcbbe8b6cd10248955/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.899040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d945d63cd94e49ba8ee55e748348fe5f, user_id=6bf98efd067843fcbbe8b6cd10248955, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.901708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.914153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 789/1586] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:15 2022] PUT /identity/v3/projects/d945d63cd94e49ba8ee55e748348fe5f/users/6bf98efd067843fcbbe8b6cd10248955/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:15.914989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.920862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 798/1587] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:15.921849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a5885-01c2-4099-8366-eeee39e32e7d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:15.937484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a5885-01c2-4099-8366-eeee39e32e7d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.988834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56b36-3a58-465d-ba73-d7d2cddb5f5a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:15.993897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36974214-90f7-499b-b389-641986817773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.994525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36974214-90f7-499b-b389-641986817773 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.994806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36974214-90f7-499b-b389-641986817773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.995107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:15.995237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36974214-90f7-499b-b389-641986817773 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.995745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:15.995895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36974214-90f7-499b-b389-641986817773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.996077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:15.996297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:15.996993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:15.997739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36974214-90f7-499b-b389-641986817773 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:15.998579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.012251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 799/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.012251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.022427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 790/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:15 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:16.022599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9d61a-a0f8-410b-af52-2a56f2314c84 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.022732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36974214-90f7-499b-b389-641986817773 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.026912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.027539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.027820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.028092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.028772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.030763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36974214-90f7-499b-b389-641986817773 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.030887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.035405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.035997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.036279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.036560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.037095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:16.037227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.038824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.042540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 800/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.043711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.052241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 791/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.052241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.057720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f67cc-ecb5-46fb-a64d-e90857ab5058 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.059579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd65fa-6773-4c19-ac53-6fafdea40462 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.063184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.063801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.064085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.064359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.065047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.065307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ded0a6-b527-4446-b514-0b5fcc76934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.066038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ded0a6-b527-4446-b514-0b5fcc76934c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.066407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ded0a6-b527-4446-b514-0b5fcc76934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.066639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.066887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ded0a6-b527-4446-b514-0b5fcc76934c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.067671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ded0a6-b527-4446-b514-0b5fcc76934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.069829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ded0a6-b527-4446-b514-0b5fcc76934c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.077781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 801/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.078560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.084462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 792/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.085737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed1199-6383-46fa-91ac-1b66991d31d2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.086021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed1199-6383-46fa-91ac-1b66991d31d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.086292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed1199-6383-46fa-91ac-1b66991d31d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.091103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0570-ec16-450f-b6c1-f4fe28c05cb4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.095793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.096466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.096751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.097027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.097704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.099615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.114468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f3ed1199-6383-46fa-91ac-1b66991d31d2 None None] MFA Rules not processed for user `6bf98efd067843fcbbe8b6cd10248955`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:16.115840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3ed1199-6383-46fa-91ac-1b66991d31d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:16.130082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 802/1594] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:16.130082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.153238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:16.188178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 793/1595] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:16.189132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed1199-6383-46fa-91ac-1b66991d31d2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.192821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1369e-a8d7-4ebe-8bcd-9f4b34fc7a8e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.197708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.198329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.198609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.198882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.199244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed1199-6383-46fa-91ac-1b66991d31d2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.199656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.201200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.204576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.205182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.205463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.205738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.206428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.208061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.212633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 803/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.213227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.220760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 794/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.221576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.223697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48eb4f-4d0f-4356-828b-75d2f021c3b2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.228101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.228759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.229041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.229317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] PATH_INFO: `/v3/projects/90a0ac38df924665a9cdef3191bf3456/users/e1231b9864444ae2a1eaf1099acfc709/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.231118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621ad4-d952-46bc-914f-848ecb401441 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.236242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.236839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.237149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.237400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.238080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.239798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.244899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a0ac38df924665a9cdef3191bf3456, user_id=e1231b9864444ae2a1eaf1099acfc709, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.247695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.249510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 795/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.250270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.260975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2a2d3-79de-4a91-a891-2b4ef7c22cb4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.267865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 804/1599] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:16 2022] PUT /identity/v3/projects/90a0ac38df924665a9cdef3191bf3456/users/e1231b9864444ae2a1eaf1099acfc709/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:16.267865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.318771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.319655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.320037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.320425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] PATH_INFO: `/v3/projects/78f0767fee4a48c99d13bf34131c4282/users/3f9cc8143db243deae4184622a4a2a26/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.330179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ac8d2-77ef-4f23-a7e9-c612a6bdf0e5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.334561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f0767fee4a48c99d13bf34131c4282, user_id=3f9cc8143db243deae4184622a4a2a26, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.334858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.335498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.335776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.336072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.336751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.337386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.338325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.348400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 805/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.349321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.353115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 796/1601] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:16 2022] PUT /identity/v3/projects/78f0767fee4a48c99d13bf34131c4282/users/3f9cc8143db243deae4184622a4a2a26/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:16.354000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.360492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933302b1-5672-4e92-af68-52b516ca82a1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.394407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:16.416351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545e44-c44e-4521-8e90-671e0a469444 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.419663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.420312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.421159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.421567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.421691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.422190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.422443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.422539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.422732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.423420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.424575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.425345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.450422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 806/1602] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:16.454190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.454598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 797/1603] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:16.455519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.463871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ecb66-0a4c-4cc0-9e31-4d3354b47de0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.479020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:16.522121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb45f2-6efc-4963-9672-3bd7b0ecbdc0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.522364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379a69-252c-4515-915e-f8a83a9c508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.523094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379a69-252c-4515-915e-f8a83a9c508f admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.523376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379a69-252c-4515-915e-f8a83a9c508f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.523652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379a69-252c-4515-915e-f8a83a9c508f admin admin] PATH_INFO: `/v3/projects/d454abd075e54da496dcd9e8080c611f/users/ae2fc4f8451e4cfebeca4d8a3916a828/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.526864 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.527644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.527930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.528204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.529014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.530628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.538377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379a69-252c-4515-915e-f8a83a9c508f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d454abd075e54da496dcd9e8080c611f, user_id=ae2fc4f8451e4cfebeca4d8a3916a828, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.540607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 798/1604] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.541403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379a69-252c-4515-915e-f8a83a9c508f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.544052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.554980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef6da-6d50-4e1b-b47d-0a3d66298bd7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.555281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 807/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:16 2022] PUT /identity/v3/projects/d454abd075e54da496dcd9e8080c611f/users/ae2fc4f8451e4cfebeca4d8a3916a828/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:16.558999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007918-26b0-4e11-9f30-576ac3778648 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.558999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007918-26b0-4e11-9f30-576ac3778648 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.558999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007918-26b0-4e11-9f30-576ac3778648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.576194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-87007918-26b0-4e11-9f30-576ac3778648 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:16.577960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-87007918-26b0-4e11-9f30-576ac3778648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:16.615139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf37e21-5368-4800-b7bf-22c4e4b12655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.615808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf37e21-5368-4800-b7bf-22c4e4b12655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.616089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf37e21-5368-4800-b7bf-22c4e4b12655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.616359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf37e21-5368-4800-b7bf-22c4e4b12655 admin admin] PATH_INFO: `/v3/projects/1decfffe06f047069d94963481bd4c16/users/8626f3989b81473ba4e72f9602a46a75/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.630868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf37e21-5368-4800-b7bf-22c4e4b12655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1decfffe06f047069d94963481bd4c16, user_id=8626f3989b81473ba4e72f9602a46a75, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.633555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf37e21-5368-4800-b7bf-22c4e4b12655 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.640507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 808/1606] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:16.640880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87007918-26b0-4e11-9f30-576ac3778648 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.653377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 799/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:16 2022] PUT /identity/v3/projects/1decfffe06f047069d94963481bd4c16/users/8626f3989b81473ba4e72f9602a46a75/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:16.653556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87007918-26b0-4e11-9f30-576ac3778648 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.653647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177f6c-fabf-4502-aae0-6dae64abc89f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.653647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177f6c-fabf-4502-aae0-6dae64abc89f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.653647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7177f6c-fabf-4502-aae0-6dae64abc89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.672267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a7177f6c-fabf-4502-aae0-6dae64abc89f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:16.673611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a7177f6c-fabf-4502-aae0-6dae64abc89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:16.699804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:16.713068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.713743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.714017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.714292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] PATH_INFO: `/v3/projects/f2b26d9e0259447cb0bacf92056fc83d/users/612b7003e0fd42329ded492f3a339f1c/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.729021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b26d9e0259447cb0bacf92056fc83d, user_id=612b7003e0fd42329ded492f3a339f1c, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.731782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.734910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 800/1608] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:16.735898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7177f6c-fabf-4502-aae0-6dae64abc89f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.745863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7177f6c-fabf-4502-aae0-6dae64abc89f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.749469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 809/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:16 2022] PUT /identity/v3/projects/f2b26d9e0259447cb0bacf92056fc83d/users/612b7003e0fd42329ded492f3a339f1c/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:16.750254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.787814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:16.807440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.808064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.808368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.808640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.809324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.810982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.818532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe9be2-d78a-446a-92dd-17255600d63d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.821781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 801/1610] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:16.822608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.826647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f60534-d547-481d-b95c-53765d16f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.828092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f60534-d547-481d-b95c-53765d16f9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.828379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f60534-d547-481d-b95c-53765d16f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.828655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f60534-d547-481d-b95c-53765d16f9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.829349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f60534-d547-481d-b95c-53765d16f9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.831319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f60534-d547-481d-b95c-53765d16f9e7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.834863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091113d6-f0af-4bb9-a9a4-17f193933f41 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.839468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.840115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.840400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.840675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] PATH_INFO: `/v3/projects/1ed7c6eae05f4d949a102707cab9a626/users/d373d8477581449ca1ac0b462de7ba59/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.853045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 810/1611] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:16.854360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d55b-71d6-40a3-82f0-32fe7d65f7a1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.854653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d55b-71d6-40a3-82f0-32fe7d65f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.854951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d55b-71d6-40a3-82f0-32fe7d65f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.859722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed7c6eae05f4d949a102707cab9a626, user_id=d373d8477581449ca1ac0b462de7ba59, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.862374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.875600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7e93d55b-71d6-40a3-82f0-32fe7d65f7a1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:16.875766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 802/1612] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:16 2022] PUT /identity/v3/projects/1ed7c6eae05f4d949a102707cab9a626/users/d373d8477581449ca1ac0b462de7ba59/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:16.876487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.876940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7e93d55b-71d6-40a3-82f0-32fe7d65f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:16.932445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30bfad-2ff3-4a1d-bb4c-6e4c1306bc62 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.936066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.936741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.937027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.937304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.937461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 811/1613] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:16.938754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ed8a-c087-423a-a671-362361affc74 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.939142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ed8a-c087-423a-a671-362361affc74 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.939492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ed8a-c087-423a-a671-362361affc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.947630 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:16.949263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:16.958620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b028ed8a-c087-423a-a671-362361affc74 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:16.959854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b028ed8a-c087-423a-a671-362361affc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:16.960182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 803/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:16.960980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:16.968895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 812/1615] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:16.970147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9ec5-0fa9-4784-9dd9-92f9ad3b6372 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.970326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d86c3-a73e-4d92-84de-506cd6cc92f2 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:16.970437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9ec5-0fa9-4784-9dd9-92f9ad3b6372 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.970689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9ec5-0fa9-4784-9dd9-92f9ad3b6372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:16.982033 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:16.983658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:16.984728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:16.984866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.000208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-eb2f9ec5-0fa9-4784-9dd9-92f9ad3b6372 None None] MFA Rules not processed for user `612b7003e0fd42329ded492f3a339f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:17.001977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-eb2f9ec5-0fa9-4784-9dd9-92f9ad3b6372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:17.003078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.004598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.017422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 804/1616] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:17.018068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.027620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39de7-ea36-456d-9fdf-131d9b476a02 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.033621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.034345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.034705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.035081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] PATH_INFO: `/v3/projects/20f36b7cc4f348cc908d69917b9ff03f/users/5526c6cd1c474f0386890ee563230c15/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.051583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f36b7cc4f348cc908d69917b9ff03f, user_id=5526c6cd1c474f0386890ee563230c15, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.054436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.055581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:17.069914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 805/1617] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:17 2022] PUT /identity/v3/projects/20f36b7cc4f348cc908d69917b9ff03f/users/5526c6cd1c474f0386890ee563230c15/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:17.073465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.081367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 813/1618] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:17.085524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.086054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.086540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.110051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:17.111403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:17.153243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a01bd-45f7-45fa-afcd-8ecf31edbda6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.159844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.160813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.161098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.161377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.162375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.163873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.177042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 806/1619] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:17.177976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.181805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 814/1620] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:17.185971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.188183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:17.197631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:17.251034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8c9c2-5ec5-49e7-a755-e142a8d0b5ad admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.255246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.255881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.256165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.256439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.260654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b131f13-dbcc-4459-927f-dbdde8f1e78b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.267390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.267598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.268507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.268972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.269261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.270086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.279729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 807/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:17.281722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.283352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.285094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.291575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef7cb8-cd2d-4087-b99d-7a12eae026e2 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.296446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 815/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:17.297473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.297599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.298102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.298387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.298678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.299399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.301016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.312038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578f076-9c5b-4b58-9655-c3f3f5e3d3be service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.313112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 808/1623] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:17.316289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.323814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.324510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.324992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.324992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.325666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.331127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4921d-8d5f-4d00-b5aa-d13fac347d19 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.331320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.336702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.337435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.337724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.338002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] PATH_INFO: `/v3/projects/d987f6c770a3457eba0dca5c7e7e918a/users/be6a987e206947498ee48f590c65ab7c/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.357889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d987f6c770a3457eba0dca5c7e7e918a, user_id=be6a987e206947498ee48f590c65ab7c, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.364937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.377018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 816/1624] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:17 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:17.377967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.387311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 809/1625] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:17 2022] PUT /identity/v3/projects/d987f6c770a3457eba0dca5c7e7e918a/users/be6a987e206947498ee48f590c65ab7c/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:17.388455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.465532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88485e8-94ac-4969-bc55-ed87bd0bd705 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.487926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130bca4-bbb2-46a6-bf21-48543b0b5ec0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.488528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:17.496707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.497727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.498154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.500752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] PATH_INFO: `/v3/projects/20f36b7cc4f348cc908d69917b9ff03f/users/5526c6cd1c474f0386890ee563230c15/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.506633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f36b7cc4f348cc908d69917b9ff03f, user_id=5526c6cd1c474f0386890ee563230c15, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.510030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.527130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 810/1626] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:17 2022] PUT /identity/v3/projects/20f36b7cc4f348cc908d69917b9ff03f/users/5526c6cd1c474f0386890ee563230c15/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:17.528110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.540543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.541294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.541677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.542053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.556718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.558322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.583719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 817/1627] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:17.584952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.603380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c497143-2a7f-491a-a77d-3ee94d3d7a2d service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.625084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea7e65-65d9-4e15-b581-7c2725dfb509 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.629797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0fcbb-8ad8-4cda-997a-ab224143bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.630436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0fcbb-8ad8-4cda-997a-ab224143bb5b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.630819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0fcbb-8ad8-4cda-997a-ab224143bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.631121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0fcbb-8ad8-4cda-997a-ab224143bb5b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.631784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0fcbb-8ad8-4cda-997a-ab224143bb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.633835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0fcbb-8ad8-4cda-997a-ab224143bb5b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.668856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 811/1628] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:17 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:17.671309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88f63-a6c1-442d-96dd-1b7ed12f5ffa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.671608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88f63-a6c1-442d-96dd-1b7ed12f5ffa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.671925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88f63-a6c1-442d-96dd-1b7ed12f5ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.681227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.682075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.682534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.682882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.683120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:17.683891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.687351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.705948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 818/1629] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:17.707525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.724736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48e12-02c6-421f-9e24-457aff379d52 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.734460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.735422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.736472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.736786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6ec88f63-a6c1-442d-96dd-1b7ed12f5ffa None None] MFA Rules not processed for user `5526c6cd1c474f0386890ee563230c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:17.737257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.738065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ec88f63-a6c1-442d-96dd-1b7ed12f5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:17.738507 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.740802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.775012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 819/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:17.775012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.788185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5cb8a-8003-4f7c-99de-d419701fb062 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.794992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:17.797164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.797552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.797935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] PATH_INFO: `/v3/projects/d987f6c770a3457eba0dca5c7e7e918a/users/be6a987e206947498ee48f590c65ab7c/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.800324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d987f6c770a3457eba0dca5c7e7e918a, user_id=be6a987e206947498ee48f590c65ab7c, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:17.803459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:17.819675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 820/1631] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:17 2022] PUT /identity/v3/projects/d987f6c770a3457eba0dca5c7e7e918a/users/be6a987e206947498ee48f590c65ab7c/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:17.820853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:17.952990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 812/1632] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:17.958614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c26b3-e1c7-4ac8-8223-16be0e68ae94 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:17.960126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c26b3-e1c7-4ac8-8223-16be0e68ae94 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:17.960302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c26b3-e1c7-4ac8-8223-16be0e68ae94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:17.983952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a7e-1ccc-4b94-9475-de37ee618a07 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:17.999476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:18.000582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.007649 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.008205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] PATH_INFO: `/v3/projects/7465b43261cb4d9bbbdc4dd8b8a728ff/users/85b7a641bce8458caeda92791b2c2c48/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.029147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-560c26b3-e1c7-4ac8-8223-16be0e68ae94 None None] MFA Rules not processed for user `be6a987e206947498ee48f590c65ab7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:18.031290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-560c26b3-e1c7-4ac8-8223-16be0e68ae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:18.039832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7465b43261cb4d9bbbdc4dd8b8a728ff, user_id=85b7a641bce8458caeda92791b2c2c48, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:18.047637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:18.072166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 821/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:17 2022] PUT /identity/v3/projects/7465b43261cb4d9bbbdc4dd8b8a728ff/users/85b7a641bce8458caeda92791b2c2c48/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:18.073973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:18.122446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:18.164745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 813/1634] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:18.165808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c26b3-e1c7-4ac8-8223-16be0e68ae94 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:18.179809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c26b3-e1c7-4ac8-8223-16be0e68ae94 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:18.192482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44f20-8bf3-4495-a189-a124dde17420 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:18.203490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:18.204293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.204768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.206547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.260147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:18.261117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.261429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.261715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.262468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:18.265117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:18.285522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 814/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:18.286958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:18.316076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcac6a-0b82-45a7-9c64-5f307f31a5cc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:18.323742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:18.324433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.324688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:18.325201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.325573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.328465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:18.338434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:18.347490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 822/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:18 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:18.349117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:18.367764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c4eb0-a589-455f-9154-5f9065368eb2 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:18.378471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36589e-ba16-4617-8550-d76f7d1aae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:18.379610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36589e-ba16-4617-8550-d76f7d1aae6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.380619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36589e-ba16-4617-8550-d76f7d1aae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.381076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36589e-ba16-4617-8550-d76f7d1aae6d admin admin] PATH_INFO: `/v3/projects/7465b43261cb4d9bbbdc4dd8b8a728ff/users/85b7a641bce8458caeda92791b2c2c48/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.384806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36589e-ba16-4617-8550-d76f7d1aae6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7465b43261cb4d9bbbdc4dd8b8a728ff, user_id=85b7a641bce8458caeda92791b2c2c48, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:18.390611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36589e-ba16-4617-8550-d76f7d1aae6d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:18.411372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 823/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:18 2022] PUT /identity/v3/projects/7465b43261cb4d9bbbdc4dd8b8a728ff/users/85b7a641bce8458caeda92791b2c2c48/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:18.419589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855b87-3439-4f5e-9d21-f4b8abecf431 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.419975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855b87-3439-4f5e-9d21-f4b8abecf431 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.420308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855b87-3439-4f5e-9d21-f4b8abecf431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.443946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:18.447356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:18.471306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c0855b87-3439-4f5e-9d21-f4b8abecf431 None None] MFA Rules not processed for user `85b7a641bce8458caeda92791b2c2c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:18.473144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c0855b87-3439-4f5e-9d21-f4b8abecf431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:18.483815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 815/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:18.519896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:18.534687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c510-4a8c-452e-b871-814dda9006c0 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:18.575045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 824/1639] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:18.640158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0855b87-3439-4f5e-9d21-f4b8abecf431 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:18.658716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:18.659309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.659591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.659866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.756225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:18.757698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:18.779714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 816/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:18.783992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:18.804716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0855b87-3439-4f5e-9d21-f4b8abecf431 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:18.810241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:18.811803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:18.812562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:18.812562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:18.832423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:18.834086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:18.863277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 825/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:19.153942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:19.169525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e50e-68ba-4b08-9f5f-be04504610f8 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:19.183651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a37a6-970e-4f1e-b942-98399a7846ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:19.184333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a37a6-970e-4f1e-b942-98399a7846ea service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:19.185084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a37a6-970e-4f1e-b942-98399a7846ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:19.185368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a37a6-970e-4f1e-b942-98399a7846ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:19.277073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:19.321126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a37a6-970e-4f1e-b942-98399a7846ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:19.322646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a37a6-970e-4f1e-b942-98399a7846ea service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:19.328810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:19.345783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 817/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:19.387347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b646fe-3140-41e7-bfb7-7af66b5862cc service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:19.395700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:19.398028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:19.398540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:19.399188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] PATH_INFO: `/v3/users/6bf98efd067843fcbbe8b6cd10248955` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:19.402506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf98efd067843fcbbe8b6cd10248955)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:19.405933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:19.520370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf98efd067843fcbbe8b6cd10248955'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:19.536421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf98efd067843fcbbe8b6cd10248955'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:19.538627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf98efd067843fcbbe8b6cd10248955'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:19.570707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf98efd067843fcbbe8b6cd10248955'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:19.604368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf98efd067843fcbbe8b6cd10248955'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:19.617730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 826/1643] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:37:19 2022] DELETE /identity/v3/users/6bf98efd067843fcbbe8b6cd10248955 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:19.622221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064025-d765-423f-85c4-f914da49941d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:19.622761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064025-d765-423f-85c4-f914da49941d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:19.622761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064025-d765-423f-85c4-f914da49941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:19.652657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c5064025-d765-423f-85c4-f914da49941d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:19.653909 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c5064025-d765-423f-85c4-f914da49941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:19.755079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 818/1644] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:19.803514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:19.805787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:19.916874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42f5de-7f95-424b-abe0-6a881e12572d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:19.922345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:19.923157 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:19.923514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:19.923863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:19.940255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:19.942042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:19.957716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 827/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:21.165253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064025-d765-423f-85c4-f914da49941d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:21.166721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c5064025-d765-423f-85c4-f914da49941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:21.185884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064025-d765-423f-85c4-f914da49941d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:21.206694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:21.207317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:21.207653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:21.207929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] PATH_INFO: `/v3/projects/d945d63cd94e49ba8ee55e748348fe5f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:21.209297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d945d63cd94e49ba8ee55e748348fe5f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:21.212793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:21.337333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd945d63cd94e49ba8ee55e748348fe5f', 'request_id': 'req-7a096911-daa7-492c-9c46-db9021d8b5bc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.363291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd945d63cd94e49ba8ee55e748348fe5f', 'request_id': 'req-7a096911-daa7-492c-9c46-db9021d8b5bc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.363291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd945d63cd94e49ba8ee55e748348fe5f', 'request_id': 'req-7a096911-daa7-492c-9c46-db9021d8b5bc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.383940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] The token cache is being invalidate because project d945d63cd94e49ba8ee55e748348fe5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:37:21.384319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.390129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.392726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 819/1646] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:37:21 2022] DELETE /identity/v3/projects/d945d63cd94e49ba8ee55e748348fe5f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:21.396777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:21.412396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7df66-b2c4-4366-bae9-6e066fd71852 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:21.424362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:21.548561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:21.549597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:21.549887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:21.550166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] PATH_INFO: `/v3/users/be6a987e206947498ee48f590c65ab7c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:21.554911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6a987e206947498ee48f590c65ab7c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:21.560088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:21.652185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6a987e206947498ee48f590c65ab7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.668151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6a987e206947498ee48f590c65ab7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.671248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6a987e206947498ee48f590c65ab7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.689307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6a987e206947498ee48f590c65ab7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.721488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-72b86bf4-3418-4b1a-ab08-2b66aa11cda7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6a987e206947498ee48f590c65ab7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:21.737308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 828/1647] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:37:21 2022] DELETE /identity/v3/users/be6a987e206947498ee48f590c65ab7c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:22.478926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:22.480817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:22.508235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096911-daa7-492c-9c46-db9021d8b5bc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:22.721610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:22.722396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:22.722680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:22.722972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] PATH_INFO: `/v3/projects/d987f6c770a3457eba0dca5c7e7e918a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:22.724307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d987f6c770a3457eba0dca5c7e7e918a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:22.746225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:22.865417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:22.934814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd987f6c770a3457eba0dca5c7e7e918a', 'request_id': 'req-94b80a1e-9c54-4c89-97b7-9e87b7326c42'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:22.965618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd987f6c770a3457eba0dca5c7e7e918a', 'request_id': 'req-94b80a1e-9c54-4c89-97b7-9e87b7326c42'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:22.993666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd987f6c770a3457eba0dca5c7e7e918a', 'request_id': 'req-94b80a1e-9c54-4c89-97b7-9e87b7326c42'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:23.028435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] The token cache is being invalidate because project d987f6c770a3457eba0dca5c7e7e918a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:37:23.029098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:23.030572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-94b80a1e-9c54-4c89-97b7-9e87b7326c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:23.036525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 820/1648] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:37:22 2022] DELETE /identity/v3/projects/d987f6c770a3457eba0dca5c7e7e918a => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:23.038458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a86d-c0e8-4166-a357-4f975721e0a5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:23.039006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a86d-c0e8-4166-a357-4f975721e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:23.039105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a86d-c0e8-4166-a357-4f975721e0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:23.089508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-87d3a86d-c0e8-4166-a357-4f975721e0a5 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:23.094400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-87d3a86d-c0e8-4166-a357-4f975721e0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:23.194539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 829/1649] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:23.204207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d93e-23ac-4baa-99ec-3ab6245970b0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:23.205258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d93e-23ac-4baa-99ec-3ab6245970b0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:23.205258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d93e-23ac-4baa-99ec-3ab6245970b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:23.238049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fb08d93e-23ac-4baa-99ec-3ab6245970b0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:23.240707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fb08d93e-23ac-4baa-99ec-3ab6245970b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:23.265428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a86d-c0e8-4166-a357-4f975721e0a5 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:23.266211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 821/1650] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:23.283972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a86d-c0e8-4166-a357-4f975721e0a5 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:23.295371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:23.296793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:23.297315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:23.297812 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:23.301032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:23.301578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:23.303854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:23.329974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 830/1651] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:37:23.334462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d93e-23ac-4baa-99ec-3ab6245970b0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:23.353700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d93e-23ac-4baa-99ec-3ab6245970b0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:23.359097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:23.359423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:23.359811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:23.359990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:23.360661 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:23.362909 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:23.451429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 822/1652] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:23 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:23.452702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:23.474846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caed69-be5d-461f-82ef-94fd0ca2d54a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:23.501682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:23.636141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:23.637184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:23.637473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:23.646594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:23.661577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:23.680638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:23.768402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 831/1653] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:23 2022] POST /identity/v3/users => generated 289 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:23.772509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:23.790497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ac49-ce6b-4872-aa01-b290190afd49 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:23.813165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:23.813843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:23.814198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:23.814538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:23.815359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:23.825350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:23.864660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 823/1654] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:23.868446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:23.890109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7745f7-7183-4d0c-a194-9f2e1ec9c671 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:23.908075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ba5f6-6ff6-4d1c-ab79-226d4e9754d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:23.909332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ba5f6-6ff6-4d1c-ab79-226d4e9754d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:23.909332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ba5f6-6ff6-4d1c-ab79-226d4e9754d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:23.909517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ba5f6-6ff6-4d1c-ab79-226d4e9754d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:23.910477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ba5f6-6ff6-4d1c-ab79-226d4e9754d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:23.912411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ba5f6-6ff6-4d1c-ab79-226d4e9754d7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:23.953445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 832/1655] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:23.958279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:23.995631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77baf14-eb8b-435e-84a4-55d32075c604 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:24.012836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:24.013773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:24.015061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:24.016916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] PATH_INFO: `/v3/projects/c9dfb28fe3b94347be6e6a1e567af95c/users/826e9929fbdb4a81a9ee236fb7c117db/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:24.116074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dfb28fe3b94347be6e6a1e567af95c, user_id=826e9929fbdb4a81a9ee236fb7c117db, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:24.121505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:24.163388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 824/1656] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:23 2022] PUT /identity/v3/projects/c9dfb28fe3b94347be6e6a1e567af95c/users/826e9929fbdb4a81a9ee236fb7c117db/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:24.173748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6884-e845-48da-816a-e558de9336e0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:24.174400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6884-e845-48da-816a-e558de9336e0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:24.174711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6884-e845-48da-816a-e558de9336e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:24.288157 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b1ae6884-e845-48da-816a-e558de9336e0 None None] MFA Rules not processed for user `826e9929fbdb4a81a9ee236fb7c117db`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:24.289547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b1ae6884-e845-48da-816a-e558de9336e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:24.515910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 833/1657] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:37:24.519936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:24.712581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba290f-926b-42d0-90b7-5bd951ad17b5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:24.726838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:24.727540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:24.727819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:24.728095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:24.730925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:24.736246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:24.840491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 825/1658] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:24 2022] POST /identity/v3/projects => generated 377 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:24.844308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6884-e845-48da-816a-e558de9336e0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:24.867558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6884-e845-48da-816a-e558de9336e0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:25.096006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:25.096675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:25.096960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:25.097237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:25.097935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:25.099946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:25.165576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 834/1659] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:24 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:25.167314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:25.193439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f60e2-6e70-40fc-997b-ef222dac93fd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:25.223656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:25.224650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:25.228940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:25.230546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:25.231938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:25.247191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:25.288719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 826/1660] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:25.289956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:25.311368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f730f-dddb-48d3-8d2c-e6dca7e644b9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:25.333169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:25.333882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:25.334218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:25.334565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] PATH_INFO: `/v3/projects/86ff0fa880184e6ebfc651de0abdafe8/users/524c11b1e9f344d492fc18a13e1cffc2/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:25.355863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:25.392793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ff0fa880184e6ebfc651de0abdafe8, user_id=524c11b1e9f344d492fc18a13e1cffc2, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:25.400495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:25.466852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 835/1661] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:25 2022] PUT /identity/v3/projects/86ff0fa880184e6ebfc651de0abdafe8/users/524c11b1e9f344d492fc18a13e1cffc2/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:25.468919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:25.494765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc65000-d0f9-495a-ac02-88af08d29a20 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:25.560290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:25.658830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86cdd3-29a8-4b66-834d-bb8f3a0f749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:25.659888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86cdd3-29a8-4b66-834d-bb8f3a0f749b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:25.660233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86cdd3-29a8-4b66-834d-bb8f3a0f749b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:25.660776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86cdd3-29a8-4b66-834d-bb8f3a0f749b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:25.663957 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86cdd3-29a8-4b66-834d-bb8f3a0f749b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:25.665970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86cdd3-29a8-4b66-834d-bb8f3a0f749b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:25.684019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 827/1662] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:25.689355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:25.710478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b679-25f1-4565-869a-fa71ff23449d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:25.720704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:25.721569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:25.722155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:25.723396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] PATH_INFO: `/v3/projects/86ff0fa880184e6ebfc651de0abdafe8/users/524c11b1e9f344d492fc18a13e1cffc2/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:25.726157 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ff0fa880184e6ebfc651de0abdafe8, user_id=524c11b1e9f344d492fc18a13e1cffc2, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:25.729737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:25.748905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 836/1663] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:25 2022] PUT /identity/v3/projects/86ff0fa880184e6ebfc651de0abdafe8/users/524c11b1e9f344d492fc18a13e1cffc2/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:25.760542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2b7b-5243-452c-8626-a3ba9e029456 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:25.761754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2b7b-5243-452c-8626-a3ba9e029456 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:25.762140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2b7b-5243-452c-8626-a3ba9e029456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:25.862270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-145f2b7b-5243-452c-8626-a3ba9e029456 None None] MFA Rules not processed for user `524c11b1e9f344d492fc18a13e1cffc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:25.865975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-145f2b7b-5243-452c-8626-a3ba9e029456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:25.998140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 828/1664] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:26.010733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:26.012906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:26.163462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5399e-b44f-47f8-9795-4cf596e20b5c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:26.171899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374916c-8841-49f7-a8d4-ab5738254efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:26.172557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374916c-8841-49f7-a8d4-ab5738254efe service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:26.172837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374916c-8841-49f7-a8d4-ab5738254efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:26.173104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374916c-8841-49f7-a8d4-ab5738254efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:26.315380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374916c-8841-49f7-a8d4-ab5738254efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:26.321028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374916c-8841-49f7-a8d4-ab5738254efe service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:26.358892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 837/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:28.347342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05782b4-8493-4541-8693-02c22aabf1fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:28.347855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05782b4-8493-4541-8693-02c22aabf1fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:28.347927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05782b4-8493-4541-8693-02c22aabf1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:28.408430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e05782b4-8493-4541-8693-02c22aabf1fa None None] MFA Rules not processed for user `e1231b9864444ae2a1eaf1099acfc709`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:28.417756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e05782b4-8493-4541-8693-02c22aabf1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:28.640461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 829/1666] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:28.654104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88a1d-2347-4300-b22b-2eff19bbae07 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:28.655076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88a1d-2347-4300-b22b-2eff19bbae07 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:28.655347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88a1d-2347-4300-b22b-2eff19bbae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:28.724172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-52b88a1d-2347-4300-b22b-2eff19bbae07 None None] MFA Rules not processed for user `e1231b9864444ae2a1eaf1099acfc709`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:28.726745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-52b88a1d-2347-4300-b22b-2eff19bbae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:28.749303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 838/1667] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:28.801865 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74040a-3c21-4eaa-8f3b-7cb11c7c066a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:28.802146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74040a-3c21-4eaa-8f3b-7cb11c7c066a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:28.802426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74040a-3c21-4eaa-8f3b-7cb11c7c066a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:28.804298 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 830/1668] 10.222.0.20 () {54 vars in 962 bytes} [Sun Jul 31 18:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:37:28.840201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:28.840749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:28.841467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:28.974399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:28.991400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:29.236065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:29.280601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 839/1669] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Jul 31 18:37:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:29.289027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74040a-3c21-4eaa-8f3b-7cb11c7c066a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:29.320378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74040a-3c21-4eaa-8f3b-7cb11c7c066a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:29.346004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f4d9-09a3-4adb-ac71-b5adcb08b6d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:29.347157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f4d9-09a3-4adb-ac71-b5adcb08b6d3 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:29.347629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f4d9-09a3-4adb-ac71-b5adcb08b6d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:29.348880 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f4d9-09a3-4adb-ac71-b5adcb08b6d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:29.409306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f4d9-09a3-4adb-ac71-b5adcb08b6d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:29.411524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f4d9-09a3-4adb-ac71-b5adcb08b6d3 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:29.434126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 831/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:29.947249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:29.950349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:29.976668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2f91-bdb7-4575-a5d7-6b8f232e75a0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:29.989159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393292db-de29-4abe-811b-a90fcdd13b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:29.989821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393292db-de29-4abe-811b-a90fcdd13b3c service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:29.990105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393292db-de29-4abe-811b-a90fcdd13b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:29.990381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393292db-de29-4abe-811b-a90fcdd13b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:30.025895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393292db-de29-4abe-811b-a90fcdd13b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:30.031544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393292db-de29-4abe-811b-a90fcdd13b3c service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:30.067766 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 840/1671] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:30.105628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be61266-26fa-4ce4-81c6-6957a5348bb1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:30.105917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be61266-26fa-4ce4-81c6-6957a5348bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:30.106200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be61266-26fa-4ce4-81c6-6957a5348bb1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:30.107852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 832/1672] 10.222.0.20 () {54 vars in 912 bytes} [Sun Jul 31 18:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:37:30.125301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1377-d97d-4542-81fc-2cd6cd09ca9b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:30.125601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1377-d97d-4542-81fc-2cd6cd09ca9b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:30.125937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1377-d97d-4542-81fc-2cd6cd09ca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:30.178273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d49d1377-d97d-4542-81fc-2cd6cd09ca9b None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:30.179823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d49d1377-d97d-4542-81fc-2cd6cd09ca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:30.215351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 841/1673] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:37:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:30.252329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be61266-26fa-4ce4-81c6-6957a5348bb1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:30.255706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2be61266-26fa-4ce4-81c6-6957a5348bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:30.391345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:30.485927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be61266-26fa-4ce4-81c6-6957a5348bb1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:30.503259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dec86-e53d-4744-bca4-8a37ca9b43a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:30.504354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dec86-e53d-4744-bca4-8a37ca9b43a1 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:30.504766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dec86-e53d-4744-bca4-8a37ca9b43a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:30.505244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dec86-e53d-4744-bca4-8a37ca9b43a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:30.545764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dec86-e53d-4744-bca4-8a37ca9b43a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:30.554716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dec86-e53d-4744-bca4-8a37ca9b43a1 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:30.600126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 833/1674] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:32.352592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836768e-186a-43ec-9ca4-3b7dbf93ad13 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:32.353077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836768e-186a-43ec-9ca4-3b7dbf93ad13 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:32.353789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836768e-186a-43ec-9ca4-3b7dbf93ad13 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:32.355588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 842/1675] 10.222.0.20 () {54 vars in 912 bytes} [Sun Jul 31 18:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:37:32.362643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aacebd-fa1e-41a7-ad6b-db0d6934734f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:32.363131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aacebd-fa1e-41a7-ad6b-db0d6934734f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:32.363414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aacebd-fa1e-41a7-ad6b-db0d6934734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:32.530655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66aacebd-fa1e-41a7-ad6b-db0d6934734f None None] MFA Rules not processed for user `235416b3ebfc42f48be079760f271fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:32.533289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66aacebd-fa1e-41a7-ad6b-db0d6934734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:32.705802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 834/1676] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:37:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:32.726975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836768e-186a-43ec-9ca4-3b7dbf93ad13 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:32.728948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1836768e-186a-43ec-9ca4-3b7dbf93ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:32.767683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836768e-186a-43ec-9ca4-3b7dbf93ad13 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:32.785831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0436b-7443-4f08-96dd-24a7a864d135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:32.787760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0436b-7443-4f08-96dd-24a7a864d135 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:32.791399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0436b-7443-4f08-96dd-24a7a864d135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:32.792298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0436b-7443-4f08-96dd-24a7a864d135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:32.823948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0436b-7443-4f08-96dd-24a7a864d135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:32.829945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0436b-7443-4f08-96dd-24a7a864d135 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:32.876126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 843/1677] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:34.835208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f39d0-b500-49ff-9e9f-296f4c1c5b50 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:34.835716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f39d0-b500-49ff-9e9f-296f4c1c5b50 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:34.835822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f39d0-b500-49ff-9e9f-296f4c1c5b50 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:34.837147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 835/1678] 10.222.0.20 () {54 vars in 961 bytes} [Sun Jul 31 18:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:37:34.843345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d2f6c-3b17-4f5d-932c-6bccfa052563 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:34.843834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d2f6c-3b17-4f5d-932c-6bccfa052563 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:34.843834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d2f6c-3b17-4f5d-932c-6bccfa052563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:34.921047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dd8d2f6c-3b17-4f5d-932c-6bccfa052563 None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:34.922111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dd8d2f6c-3b17-4f5d-932c-6bccfa052563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:35.183324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 844/1679] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Jul 31 18:37:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:37:35.190831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f39d0-b500-49ff-9e9f-296f4c1c5b50 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:35.211886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9085d-2705-43c2-b952-096c8cea991c None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:35.212169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9085d-2705-43c2-b952-096c8cea991c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:35.212673 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9085d-2705-43c2-b952-096c8cea991c None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:35.212937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f39d0-b500-49ff-9e9f-296f4c1c5b50 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:35.214492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 845/1680] 10.222.0.20 () {54 vars in 962 bytes} [Sun Jul 31 18:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:37:35.221549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39c75-4337-4cf7-9565-35ebc4b5a206 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:35.221828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39c75-4337-4cf7-9565-35ebc4b5a206 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:35.222274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39c75-4337-4cf7-9565-35ebc4b5a206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:35.224656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e702519-fe1b-44c1-9bcb-290e1e80a4eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:35.225564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e702519-fe1b-44c1-9bcb-290e1e80a4eb service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:35.226059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e702519-fe1b-44c1-9bcb-290e1e80a4eb service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:35.228459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e702519-fe1b-44c1-9bcb-290e1e80a4eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:35.231709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e702519-fe1b-44c1-9bcb-290e1e80a4eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:35.244499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f0d39c75-4337-4cf7-9565-35ebc4b5a206 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:35.246288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f0d39c75-4337-4cf7-9565-35ebc4b5a206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:35.256913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e702519-fe1b-44c1-9bcb-290e1e80a4eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:35.259653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e702519-fe1b-44c1-9bcb-290e1e80a4eb service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:35.271578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 846/1681] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Jul 31 18:37:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:37:35.273559 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa77c1-b3ab-4637-be8c-046f76f58bec None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:35.274011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa77c1-b3ab-4637-be8c-046f76f58bec None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:35.274571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa77c1-b3ab-4637-be8c-046f76f58bec None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:35.277271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 836/1682] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:35.279087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 847/1683] 10.222.0.20 () {54 vars in 912 bytes} [Sun Jul 31 18:37:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:37:35.293400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311122e-79b8-4f71-960e-5caf98024b55 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:35.294345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311122e-79b8-4f71-960e-5caf98024b55 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:35.296245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311122e-79b8-4f71-960e-5caf98024b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:35.359374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5311122e-79b8-4f71-960e-5caf98024b55 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:35.367295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5311122e-79b8-4f71-960e-5caf98024b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:35.410300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 837/1684] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:37:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:35.543467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa77c1-b3ab-4637-be8c-046f76f58bec None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:35.545478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-28fa77c1-b3ab-4637-be8c-046f76f58bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:35.596201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa77c1-b3ab-4637-be8c-046f76f58bec None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:35.622576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc837cc-c187-4229-92d3-2cc68e66e490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:35.624299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc837cc-c187-4229-92d3-2cc68e66e490 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:35.624743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc837cc-c187-4229-92d3-2cc68e66e490 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:35.625171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc837cc-c187-4229-92d3-2cc68e66e490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:35.673404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc837cc-c187-4229-92d3-2cc68e66e490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:35.674881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc837cc-c187-4229-92d3-2cc68e66e490 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:35.726668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 848/1685] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:36.093876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b774a0-4b3c-4705-87fe-725ad9ffd0f9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:36.094375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b774a0-4b3c-4705-87fe-725ad9ffd0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:36.094527 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b774a0-4b3c-4705-87fe-725ad9ffd0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:36.112595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b1f4-b700-42b1-88d3-fad0c4db21c5 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:36.113144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b1f4-b700-42b1-88d3-fad0c4db21c5 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:36.113232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b1f4-b700-42b1-88d3-fad0c4db21c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:36.167514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-67b774a0-4b3c-4705-87fe-725ad9ffd0f9 None None] MFA Rules not processed for user `e1231b9864444ae2a1eaf1099acfc709`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:36.193000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-67b774a0-4b3c-4705-87fe-725ad9ffd0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:36.234437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6a96b1f4-b700-42b1-88d3-fad0c4db21c5 None None] MFA Rules not processed for user `3f9cc8143db243deae4184622a4a2a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:36.235698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6a96b1f4-b700-42b1-88d3-fad0c4db21c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:36.256048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 838/1686] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:36.580803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 849/1687] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:36.589445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b774a0-4b3c-4705-87fe-725ad9ffd0f9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:36.621543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b774a0-4b3c-4705-87fe-725ad9ffd0f9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:36.635556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729f1b6-2945-44e0-8415-0b6cb2872396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:36.636454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f1b6-2945-44e0-8415-0b6cb2872396 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:36.637357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f1b6-2945-44e0-8415-0b6cb2872396 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:36.638704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f1b6-2945-44e0-8415-0b6cb2872396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:36.660350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729f1b6-2945-44e0-8415-0b6cb2872396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:36.662071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729f1b6-2945-44e0-8415-0b6cb2872396 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:36.695568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 839/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:37.174320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015a36-c632-405f-b347-01e75d324573 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:37.174320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015a36-c632-405f-b347-01e75d324573 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:37.174320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015a36-c632-405f-b347-01e75d324573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:37.245880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5b015a36-c632-405f-b347-01e75d324573 None None] MFA Rules not processed for user `ae2fc4f8451e4cfebeca4d8a3916a828`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:37.247514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5b015a36-c632-405f-b347-01e75d324573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:37.301678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff92a4-f855-4768-aeda-85bb124fdca1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:37.302498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff92a4-f855-4768-aeda-85bb124fdca1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:37.302498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff92a4-f855-4768-aeda-85bb124fdca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:37.379554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:37.463016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-25ff92a4-f855-4768-aeda-85bb124fdca1 None None] MFA Rules not processed for user `8626f3989b81473ba4e72f9602a46a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:37.464471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-25ff92a4-f855-4768-aeda-85bb124fdca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:37.612938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 850/1689] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:37.625782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b015a36-c632-405f-b347-01e75d324573 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:37.683624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b015a36-c632-405f-b347-01e75d324573 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:37.691084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:37.705972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:37.710251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:37.710719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:37.711235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:37.737155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:37.738610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:37.740797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 840/1690] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:37.757914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717b49-f00c-406f-8ad7-74d467e7edf6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:37.758466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717b49-f00c-406f-8ad7-74d467e7edf6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:37.758760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717b49-f00c-406f-8ad7-74d467e7edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:37.790357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 851/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:37.836097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c717b49-f00c-406f-8ad7-74d467e7edf6 None None] MFA Rules not processed for user `8626f3989b81473ba4e72f9602a46a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:37.838485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c717b49-f00c-406f-8ad7-74d467e7edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:37.884700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 841/1692] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:37.973893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:38.025138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1991-c7aa-4f09-99b7-fe426d02a7e5 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:38.038044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f33ab6-c583-4282-8493-6d52538239d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:38.040577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33ab6-c583-4282-8493-6d52538239d3 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:38.040897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33ab6-c583-4282-8493-6d52538239d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:38.041228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33ab6-c583-4282-8493-6d52538239d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:38.058261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f33ab6-c583-4282-8493-6d52538239d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:38.061527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f33ab6-c583-4282-8493-6d52538239d3 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:38.084685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 852/1693] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:39.288761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae9ef-6888-4f80-886c-3d3160f41e36 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:39.289235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae9ef-6888-4f80-886c-3d3160f41e36 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:39.289332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae9ef-6888-4f80-886c-3d3160f41e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:39.417795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cedae9ef-6888-4f80-886c-3d3160f41e36 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:39.419284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cedae9ef-6888-4f80-886c-3d3160f41e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:39.528330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:39.528761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:39.528922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:39.658413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 842/1694] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:37:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:37:39.660942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] MFA Rules not processed for user `d373d8477581449ca1ac0b462de7ba59`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:39.666434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:39.925261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 853/1695] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:39.936201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae9ef-6888-4f80-886c-3d3160f41e36 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:39.960899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae9ef-6888-4f80-886c-3d3160f41e36 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:39.979915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a0d1c-019b-4db2-83cb-f39a3da5a7ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:39.980860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0d1c-019b-4db2-83cb-f39a3da5a7ff service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:39.981639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0d1c-019b-4db2-83cb-f39a3da5a7ff service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:39.982401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0d1c-019b-4db2-83cb-f39a3da5a7ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:40.018159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a0d1c-019b-4db2-83cb-f39a3da5a7ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:40.024187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a0d1c-019b-4db2-83cb-f39a3da5a7ff service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:40.048129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:40.049565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:40.050216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 843/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:40.234669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196ecf9-512e-455c-a8af-ae3fc3c8cee5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:40.235281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196ecf9-512e-455c-a8af-ae3fc3c8cee5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:40.235712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196ecf9-512e-455c-a8af-ae3fc3c8cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:40.299987 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8196ecf9-512e-455c-a8af-ae3fc3c8cee5 None None] MFA Rules not processed for user `235416b3ebfc42f48be079760f271fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:40.302325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8196ecf9-512e-455c-a8af-ae3fc3c8cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:40.325446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 844/1697] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:37:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:40.372786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ad55-86ab-4081-8511-fc7db8db4382 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:40.397256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:40.397908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:40.398185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:40.398635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:40.411478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:40.421565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:40.424177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:40.452085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 854/1698] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:40.656340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196ecf9-512e-455c-a8af-ae3fc3c8cee5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:40.679672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196ecf9-512e-455c-a8af-ae3fc3c8cee5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:40.704875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0b7d-138e-462f-a6ad-c3fdb877efdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:40.707536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0b7d-138e-462f-a6ad-c3fdb877efdb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:40.710380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0b7d-138e-462f-a6ad-c3fdb877efdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:40.711646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0b7d-138e-462f-a6ad-c3fdb877efdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:40.768214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0b7d-138e-462f-a6ad-c3fdb877efdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:40.773238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0b7d-138e-462f-a6ad-c3fdb877efdb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:40.807049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 845/1699] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:40.861743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:40.864632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:41.168478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1564b81-faf4-4d8d-a941-102ab127b4cf service swift] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:41.221738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:41.222420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:41.227052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:41.231311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] PATH_INFO: `/v3/users/11d41e8f708645c08a586d8b6d2d8c35` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:41.236477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d41e8f708645c08a586d8b6d2d8c35)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:41.255344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:41.511300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d41e8f708645c08a586d8b6d2d8c35'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:41.535785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d41e8f708645c08a586d8b6d2d8c35'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:41.536806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d41e8f708645c08a586d8b6d2d8c35'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:41.558460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d41e8f708645c08a586d8b6d2d8c35'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:41.609742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d41e8f708645c08a586d8b6d2d8c35'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:41.639610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 855/1700] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:37:40 2022] DELETE /identity/v3/users/11d41e8f708645c08a586d8b6d2d8c35 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:41.644137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1cfa0-9b6f-414e-a69f-0f42552a8d62 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:41.645712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1cfa0-9b6f-414e-a69f-0f42552a8d62 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:41.646396 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1cfa0-9b6f-414e-a69f-0f42552a8d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:41.704092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1ea1cfa0-9b6f-414e-a69f-0f42552a8d62 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:41.705347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ea1cfa0-9b6f-414e-a69f-0f42552a8d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:41.899708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 846/1701] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:41.944777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:41.947597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:42.119819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b644842-caa5-4aff-aba7-ff84705a4a31 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:42.142411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:42.146064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:42.146624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:42.147107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:42.180400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:42.183217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:42.226303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 856/1702] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:43.844292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:43.845280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:43.845777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:43.898979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] MFA Rules not processed for user `235416b3ebfc42f48be079760f271fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:43.900624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:43.922071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 847/1703] 10.222.0.17 () {58 vars in 1015 bytes} [Sun Jul 31 18:37:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:44.108656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:44.124019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:44.137581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ba03-a1c4-42ad-a848-2a2c9bad9c15 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:44.149390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:44.151583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:44.153213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:44.153697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:44.168906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:44.173284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:44.194614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 857/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:47.821133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:47.823069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:47.865419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd5f2a-ae92-4c03-bca4-ad8a2238657d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:47.882092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:47.883399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:47.884015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:47.884448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] PATH_INFO: `/v3/projects/cb4cee9734bb49668a3129f6a55a7bfe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:47.887641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4cee9734bb49668a3129f6a55a7bfe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:47.895617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:47.929501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:48.036843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4cee9734bb49668a3129f6a55a7bfe', 'request_id': 'req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.080762 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4cee9734bb49668a3129f6a55a7bfe', 'request_id': 'req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.103423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4cee9734bb49668a3129f6a55a7bfe', 'request_id': 'req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.143425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] The token cache is being invalidate because project cb4cee9734bb49668a3129f6a55a7bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:37:48.143852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.147651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3ff6480d-b6a2-4a11-941d-6663cf7bb94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.149412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 848/1705] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:37:47 2022] DELETE /identity/v3/projects/cb4cee9734bb49668a3129f6a55a7bfe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:48.160204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:48.182504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:48.199997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0dc53-d104-4f81-8761-8c7441bad663 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:48.306635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:48.307198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:48.307816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:48.388674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] MFA Rules not processed for user `d373d8477581449ca1ac0b462de7ba59`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:48.422839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:48.518638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:48.519335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:48.519881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:48.520153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] PATH_INFO: `/v3/users/5526c6cd1c474f0386890ee563230c15` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:48.527872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5526c6cd1c474f0386890ee563230c15)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:48.530474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:48.556386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 849/1706] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:48.676803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:48.678767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:48.694865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5526c6cd1c474f0386890ee563230c15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.706866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743553e-67f1-4db2-87e1-bc5c3ab06825 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:48.718250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5526c6cd1c474f0386890ee563230c15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.720071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:48.720467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5526c6cd1c474f0386890ee563230c15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.720770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:48.721049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:48.721668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] PATH_INFO: `/v3/users/826e9929fbdb4a81a9ee236fb7c117db` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:48.723678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=826e9929fbdb4a81a9ee236fb7c117db)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:48.731372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:37:48.731372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 31 18:37:48.731372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: Jul 31 18:37:48.733933 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:48.757995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5526c6cd1c474f0386890ee563230c15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.785338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-40790d08-0de4-4aa7-b4cc-ce9fbbf48c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5526c6cd1c474f0386890ee563230c15'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.849565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 858/1707] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:37:48 2022] DELETE /identity/v3/users/5526c6cd1c474f0386890ee563230c15 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:48.903283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826e9929fbdb4a81a9ee236fb7c117db'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.907176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826e9929fbdb4a81a9ee236fb7c117db'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.923299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826e9929fbdb4a81a9ee236fb7c117db'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.979606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826e9929fbdb4a81a9ee236fb7c117db'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:48.981075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826e9929fbdb4a81a9ee236fb7c117db'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:49.082248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 850/1708] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:37:48 2022] DELETE /identity/v3/users/826e9929fbdb4a81a9ee236fb7c117db => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:37:49.092365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5a87-3858-4617-887d-9c0b8639eea6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:49.092975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5a87-3858-4617-887d-9c0b8639eea6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:49.093430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5a87-3858-4617-887d-9c0b8639eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:49.128633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-52bc5a87-3858-4617-887d-9c0b8639eea6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:49.131733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-52bc5a87-3858-4617-887d-9c0b8639eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:49.334797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 859/1709] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:49.729328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:49.730820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:49.792919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:49.884171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8855-c8f8-49cc-a0fd-841700a2a0ba None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:49.884171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8855-c8f8-49cc-a0fd-841700a2a0ba None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:49.884540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8855-c8f8-49cc-a0fd-841700a2a0ba None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:49.886922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 860/1710] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:37:49.942438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80e4e4-59c2-4aa5-9ced-7b4fbe1003c4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:49.955155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751698d9-1b83-40ee-b54b-c1faeb8080ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:49.960423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751698d9-1b83-40ee-b54b-c1faeb8080ed service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:49.960423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751698d9-1b83-40ee-b54b-c1faeb8080ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:49.960423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751698d9-1b83-40ee-b54b-c1faeb8080ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:50.022474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751698d9-1b83-40ee-b54b-c1faeb8080ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:50.027239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751698d9-1b83-40ee-b54b-c1faeb8080ed service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:50.069485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 851/1711] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:50.141835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2aaa7-b3ad-4273-b650-3aa22f6051e7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:50.142454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2aaa7-b3ad-4273-b650-3aa22f6051e7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:50.142975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2aaa7-b3ad-4273-b650-3aa22f6051e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:50.236339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e5f2aaa7-b3ad-4273-b650-3aa22f6051e7 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:50.240613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e5f2aaa7-b3ad-4273-b650-3aa22f6051e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:50.319961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:50.439086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 861/1712] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:37:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:51.350332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65120-968f-4e1e-929b-ce2c7719b04d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:51.351769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65120-968f-4e1e-929b-ce2c7719b04d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:51.352487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65120-968f-4e1e-929b-ce2c7719b04d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:51.355285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 852/1713] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:37:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:37:51.472467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d30ef-1fce-4b0a-9610-31f093b793cf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:51.473494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d30ef-1fce-4b0a-9610-31f093b793cf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:51.474115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d30ef-1fce-4b0a-9610-31f093b793cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:51.552672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d84d30ef-1fce-4b0a-9610-31f093b793cf None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:51.557203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d84d30ef-1fce-4b0a-9610-31f093b793cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:51.593077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 862/1714] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:37:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:52.391190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65120-968f-4e1e-929b-ce2c7719b04d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:52.400675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dda65120-968f-4e1e-929b-ce2c7719b04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:52.467659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65120-968f-4e1e-929b-ce2c7719b04d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:52.487441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:52.488090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:52.488376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:52.488654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:52.538530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:52.540219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:52.552822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:52.553797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:52.554231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:52.592836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 853/1715] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:52.607870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] MFA Rules not processed for user `3f9cc8143db243deae4184622a4a2a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:52.610300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:52.781153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:52.782619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:52.821905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 863/1716] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:52.824141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28642ed6-c19f-4de9-b4a2-f464e337b04d service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:52.873723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d585ed-8c6c-47ec-9707-9e687cc87ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:52.877637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d585ed-8c6c-47ec-9707-9e687cc87ced service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:52.878143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d585ed-8c6c-47ec-9707-9e687cc87ced service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:52.881133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d585ed-8c6c-47ec-9707-9e687cc87ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:52.928612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d585ed-8c6c-47ec-9707-9e687cc87ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:52.930362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d585ed-8c6c-47ec-9707-9e687cc87ced service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:52.954372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 854/1717] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:37:53.994327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:53.995820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:54.033780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4a48-e766-49aa-bed5-7646485f51db None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:54.048805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:54.049761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:54.053231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:54.053750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] PATH_INFO: `/v3/projects/20f36b7cc4f348cc908d69917b9ff03f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:54.055601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f36b7cc4f348cc908d69917b9ff03f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:54.070284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: WARNING py.warnings [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:37:54.070284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: warnings.warn(msg) Jul 31 18:37:54.070284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: Jul 31 18:37:54.072310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:54.229602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f36b7cc4f348cc908d69917b9ff03f', 'request_id': 'req-b17fac15-7036-47ba-aff8-8f6d2a473acb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:54.246546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f36b7cc4f348cc908d69917b9ff03f', 'request_id': 'req-b17fac15-7036-47ba-aff8-8f6d2a473acb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:54.265251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f36b7cc4f348cc908d69917b9ff03f', 'request_id': 'req-b17fac15-7036-47ba-aff8-8f6d2a473acb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:54.312873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] The token cache is being invalidate because project 20f36b7cc4f348cc908d69917b9ff03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:37:54.315081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:54.316217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b17fac15-7036-47ba-aff8-8f6d2a473acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:54.321416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 864/1718] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:37:53 2022] DELETE /identity/v3/projects/20f36b7cc4f348cc908d69917b9ff03f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:54.326667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cdbbd-8a6f-49cb-8a62-612310f1a269 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:54.327635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cdbbd-8a6f-49cb-8a62-612310f1a269 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:54.328070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cdbbd-8a6f-49cb-8a62-612310f1a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:54.379037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3d9cdbbd-8a6f-49cb-8a62-612310f1a269 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:54.380355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d9cdbbd-8a6f-49cb-8a62-612310f1a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:54.637061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 855/1719] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:54.637283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025de47-9fbd-452a-b7ca-05f5980c662b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:54.637283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025de47-9fbd-452a-b7ca-05f5980c662b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:54.637283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025de47-9fbd-452a-b7ca-05f5980c662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:54.700371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1025de47-9fbd-452a-b7ca-05f5980c662b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:54.705697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1025de47-9fbd-452a-b7ca-05f5980c662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:54.728011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 865/1720] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:54.732923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cdbbd-8a6f-49cb-8a62-612310f1a269 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:54.758542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cdbbd-8a6f-49cb-8a62-612310f1a269 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:54.775280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:54.776308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:54.777841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:54.778231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:54.779223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:54.779645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:54.781972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:54.812344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 856/1721] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:37:54.816389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025de47-9fbd-452a-b7ca-05f5980c662b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:54.839916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025de47-9fbd-452a-b7ca-05f5980c662b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:54.846759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0cdf-9c0f-45e8-b3c4-13884a735b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:54.848319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0cdf-9c0f-45e8-b3c4-13884a735b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:54.848928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0cdf-9c0f-45e8-b3c4-13884a735b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:54.849851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0cdf-9c0f-45e8-b3c4-13884a735b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:54.852880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d0cdf-9c0f-45e8-b3c4-13884a735b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:54.856771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d0cdf-9c0f-45e8-b3c4-13884a735b3d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:54.919688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 866/1722] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:54 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:54.923419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:54.934042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906056b9-a4c8-466d-9dcd-a3e09f4d111e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:55.187917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:55.190508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:55.191761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:55.194951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:55.203355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:55.205085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:55.243730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f0d3-de05-479b-9b3a-4d9138be51b4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:55.244348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f0d3-de05-479b-9b3a-4d9138be51b4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:55.244721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f0d3-de05-479b-9b3a-4d9138be51b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:55.289368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b077f0d3-de05-479b-9b3a-4d9138be51b4 None None] MFA Rules not processed for user `ae2fc4f8451e4cfebeca4d8a3916a828`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:55.293488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b077f0d3-de05-479b-9b3a-4d9138be51b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:55.298374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 857/1723] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:54 2022] POST /identity/v3/users => generated 283 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:55.307351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:55.310332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:55.354966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150c3cb-322b-465e-9465-f4e0bad23d6e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:55.376549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:55.378176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:55.378489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:55.381001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:55.385528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:55.387474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:55.402319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:55.408239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 867/1724] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:55.445840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f0d3-de05-479b-9b3a-4d9138be51b4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:55.448093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 858/1725] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:55.462393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f0d3-de05-479b-9b3a-4d9138be51b4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:55.475254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e785462-a883-4e86-8872-98e3b15011b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:55.477018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785462-a883-4e86-8872-98e3b15011b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:55.477682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785462-a883-4e86-8872-98e3b15011b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:55.478185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785462-a883-4e86-8872-98e3b15011b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:55.479861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e785462-a883-4e86-8872-98e3b15011b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:55.483668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e785462-a883-4e86-8872-98e3b15011b6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:55.505730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 868/1726] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:55.509926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:55.546179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fbf38-884b-478b-9d50-42f334a3d7f2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:55.553662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:55.554557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:55.555116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:55.555673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] PATH_INFO: `/v3/projects/6d0b3fde6aeb4b5e8ffafa252b39a803/users/2de9807d5cc046eeb55e5cdbc258d5d1/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:55.580418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0b3fde6aeb4b5e8ffafa252b39a803, user_id=2de9807d5cc046eeb55e5cdbc258d5d1, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:55.586160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:55.620260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ebd8-7b55-4031-baed-854fe14c9f68 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:55.620450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 859/1727] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:55 2022] PUT /identity/v3/projects/6d0b3fde6aeb4b5e8ffafa252b39a803/users/2de9807d5cc046eeb55e5cdbc258d5d1/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:55.621082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ebd8-7b55-4031-baed-854fe14c9f68 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:55.621588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ebd8-7b55-4031-baed-854fe14c9f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:55.720925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e660ebd8-7b55-4031-baed-854fe14c9f68 None None] MFA Rules not processed for user `2de9807d5cc046eeb55e5cdbc258d5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:55.722642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e660ebd8-7b55-4031-baed-854fe14c9f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:55.780669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:55.782859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:55.992469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 869/1728] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:37:55.998996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ebd8-7b55-4031-baed-854fe14c9f68 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:56.045322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da385d5e-fa7a-4dbe-8425-6177a44084a5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:56.052719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:56.053931 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:56.054407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:56.055169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] PATH_INFO: `/v3/projects/c9dfb28fe3b94347be6e6a1e567af95c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:56.057495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9dfb28fe3b94347be6e6a1e567af95c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:56.061679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:56.183495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ebd8-7b55-4031-baed-854fe14c9f68 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:56.199691 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9dfb28fe3b94347be6e6a1e567af95c', 'request_id': 'req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.214260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9dfb28fe3b94347be6e6a1e567af95c', 'request_id': 'req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.226548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9dfb28fe3b94347be6e6a1e567af95c', 'request_id': 'req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.265727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] The token cache is being invalidate because project c9dfb28fe3b94347be6e6a1e567af95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:37:56.267052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.268468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.272758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 860/1729] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:37:55 2022] DELETE /identity/v3/projects/c9dfb28fe3b94347be6e6a1e567af95c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:56.280896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:56.286805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:56.289585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:56.331195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:56.332161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:56.333605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:56.333992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:56.336504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:56.339972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:56.420922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 870/1730] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:55 2022] POST /identity/v3/projects => generated 365 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:37:56.429796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:56.435924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:56.492737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b20ba-7671-462d-b84f-1c2e62bf71c0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:56.509862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:56.625272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc865-eaef-4251-b4e1-b186a193230f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:56.634438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:56.634777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:56.635131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:56.635409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:56.635681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] PATH_INFO: `/v3/users/524c11b1e9f344d492fc18a13e1cffc2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:56.635838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:56.636127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:56.636406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:56.637637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524c11b1e9f344d492fc18a13e1cffc2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:56.637857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:56.639872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:56.640067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:56.682268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 871/1731] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:56 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:56.688245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:56.707416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0debb-4368-4505-a3b3-115df98f248b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:56.718349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:56.719035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:56.719498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:56.719779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:56.723810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:56.727320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:56.753889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 872/1732] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:56.758070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:56.759978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524c11b1e9f344d492fc18a13e1cffc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.760858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524c11b1e9f344d492fc18a13e1cffc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.781644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524c11b1e9f344d492fc18a13e1cffc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.781995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73783aaa-6eb9-44cd-bcaf-9f2579c60aa2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:56.795718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:56.796588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:56.796817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:56.797099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] PATH_INFO: `/v3/projects/132661b021cf4489bbf0d37f4e442ab1/users/0e6d57c04c244156b55c181535363aa0/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:56.805440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524c11b1e9f344d492fc18a13e1cffc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.806556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524c11b1e9f344d492fc18a13e1cffc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:56.828186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132661b021cf4489bbf0d37f4e442ab1, user_id=0e6d57c04c244156b55c181535363aa0, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:56.840294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:56.869089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 873/1733] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:56 2022] PUT /identity/v3/projects/132661b021cf4489bbf0d37f4e442ab1/users/0e6d57c04c244156b55c181535363aa0/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:56.873877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:56.877151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:56.879552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 861/1734] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:37:56 2022] DELETE /identity/v3/users/524c11b1e9f344d492fc18a13e1cffc2 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:57.010191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f5f4-7aca-4058-b233-ca3f8280fcf6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:57.076489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:57.188722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc1767-674b-411d-9a8d-9729b7502d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:57.189314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1767-674b-411d-9a8d-9729b7502d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:57.189594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1767-674b-411d-9a8d-9729b7502d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:57.189942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1767-674b-411d-9a8d-9729b7502d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:57.191240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc1767-674b-411d-9a8d-9729b7502d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:57.193165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc1767-674b-411d-9a8d-9729b7502d9a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:57.220850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:57.229010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 874/1735] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:57.235933 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7872f-164b-406d-b9eb-f38f85e6a2a1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:57.250268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:57.251052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:57.251326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:57.251603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] PATH_INFO: `/v3/projects/132661b021cf4489bbf0d37f4e442ab1/users/0e6d57c04c244156b55c181535363aa0/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:57.256913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132661b021cf4489bbf0d37f4e442ab1, user_id=0e6d57c04c244156b55c181535363aa0, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:57.263497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:57.296186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 862/1736] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:57 2022] PUT /identity/v3/projects/132661b021cf4489bbf0d37f4e442ab1/users/0e6d57c04c244156b55c181535363aa0/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:57.307828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:57.308391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:57.308391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:57.333025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:57.334788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:57.388684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] MFA Rules not processed for user `0e6d57c04c244156b55c181535363aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:57.392110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:57.467463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb748c0-937a-4f85-a352-f6e53a8de0f6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:57.482795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:57.484077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:57.484529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:57.484906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] PATH_INFO: `/v3/users/612b7003e0fd42329ded492f3a339f1c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:57.487011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] RBAC: Authorizing `identity:delete_user(user_id=612b7003e0fd42329ded492f3a339f1c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:57.490831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:57.510026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 875/1737] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:57.518597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:57.520708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:57.541055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:57.599776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612b7003e0fd42329ded492f3a339f1c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:57.600625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612b7003e0fd42329ded492f3a339f1c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:57.625603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612b7003e0fd42329ded492f3a339f1c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:57.640178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612b7003e0fd42329ded492f3a339f1c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:57.640926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7d60e16f-b46c-4763-9eca-d3f747c1383b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612b7003e0fd42329ded492f3a339f1c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:57.684324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb28665-9d5b-4da8-b326-e4a00925ff1e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:57.687501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 863/1738] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:37:57 2022] DELETE /identity/v3/users/612b7003e0fd42329ded492f3a339f1c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:37:57.693048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:57.693332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:57.694128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:57.741085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:57.742325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:57.793334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:57.794029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:57.794330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:57.794602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:57.796571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:57.821646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:57.920810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 864/1739] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:57.946338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:57.948173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:57.974536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 876/1740] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:37:57.988941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:57.990395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:58.021811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf6763-b75c-42b4-b917-6ee55fb81ad0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:58.030632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:58.032560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:58.041960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:58.042648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:58.042945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:58.043231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] PATH_INFO: `/v3/projects/86ff0fa880184e6ebfc651de0abdafe8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:58.045948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ff0fa880184e6ebfc651de0abdafe8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:58.047710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:58.225642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ff0fa880184e6ebfc651de0abdafe8', 'request_id': 'req-9551bc6d-da03-46ae-9a83-1a31793c4950'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:58.230635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e3715-ab0c-4ac9-b894-3ee6df1eb72d service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:58.244976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ff0fa880184e6ebfc651de0abdafe8', 'request_id': 'req-9551bc6d-da03-46ae-9a83-1a31793c4950'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:58.264411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ff0fa880184e6ebfc651de0abdafe8', 'request_id': 'req-9551bc6d-da03-46ae-9a83-1a31793c4950'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:58.288013 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] The token cache is being invalidate because project 86ff0fa880184e6ebfc651de0abdafe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:37:58.288456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:58.289263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:37:58.295547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 865/1741] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:37:57 2022] DELETE /identity/v3/projects/86ff0fa880184e6ebfc651de0abdafe8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:58.295547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:58.300487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:58.342390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:58.409576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eace2-5a43-490f-950a-d9c10e06df39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:58.410673 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eace2-5a43-490f-950a-d9c10e06df39 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:58.411042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eace2-5a43-490f-950a-d9c10e06df39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:58.411322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eace2-5a43-490f-950a-d9c10e06df39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:58.414298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-202eace2-5a43-490f-950a-d9c10e06df39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:58.423651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551bc6d-da03-46ae-9a83-1a31793c4950 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:58.435950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:58.436686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:58.437043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:58.437541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:58.443889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:58.513970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eace2-5a43-490f-950a-d9c10e06df39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:58.517412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eace2-5a43-490f-950a-d9c10e06df39 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:58.539700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 877/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:58.541368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59fbd2-d5d4-4cbc-a97c-c4456701dc50 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:58.541506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59fbd2-d5d4-4cbc-a97c-c4456701dc50 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:58.541904 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59fbd2-d5d4-4cbc-a97c-c4456701dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:58.585686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8e59fbd2-d5d4-4cbc-a97c-c4456701dc50 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:58.588693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8e59fbd2-d5d4-4cbc-a97c-c4456701dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:58.597219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:58.598327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:58.620979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 878/1743] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:58.626611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 866/1744] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:37:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:37:58.627431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bd66c-0e73-4e49-b595-b719fb41af4e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:58.627750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bd66c-0e73-4e49-b595-b719fb41af4e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:58.628033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bd66c-0e73-4e49-b595-b719fb41af4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:58.676955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6f7bd66c-0e73-4e49-b595-b719fb41af4e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:58.697334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6f7bd66c-0e73-4e49-b595-b719fb41af4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:58.741322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:58.741971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 879/1745] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:58.757091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e78c3-3949-47eb-81a5-22851da7ecd9 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:58.771560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:58.772905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:58.773836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:58.774572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:58.775366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:37:58.778105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:58.796310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:58.838444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bd66c-0e73-4e49-b595-b719fb41af4e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:58.843424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 867/1746] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:37:58.851883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bd66c-0e73-4e49-b595-b719fb41af4e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:58.871754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:58.873020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:58.873294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:58.873535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:58.874214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:58.886830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:58.898644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:58.949207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:58.956273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 880/1747] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:58 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:58.962493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede07e8-a24d-409d-a35b-75e88470f59d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.082127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.083229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.083724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.084235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.085425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:59.087683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:59.122685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 868/1748] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:58 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:59.128102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:59.144259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284d18e-ab6c-4036-8636-57412f91ca62 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.151548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.152252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.152537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.152862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.153884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:59.156060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:59.174302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 881/1749] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:59.179463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:59.192948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39e9f-5f9f-4d3c-a9d2-f8f86363313f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.198733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1490642-4638-4427-b326-b26262fb6b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.199437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490642-4638-4427-b326-b26262fb6b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.199733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490642-4638-4427-b326-b26262fb6b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.199993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490642-4638-4427-b326-b26262fb6b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.201267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1490642-4638-4427-b326-b26262fb6b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:59.203064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1490642-4638-4427-b326-b26262fb6b4e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:59.218146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 869/1750] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:59.222872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:59.240803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dad05-2039-42bb-ba5a-79aa230f94e1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.249067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.249834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.250179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.250517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] PATH_INFO: `/v3/projects/fb151b996d9a40a299f0972584490f6e/users/ec40d13187d14b5791cf206c71c9f963/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.269828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb151b996d9a40a299f0972584490f6e, user_id=ec40d13187d14b5791cf206c71c9f963, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:59.274089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:59.299045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 882/1751] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:59 2022] PUT /identity/v3/projects/fb151b996d9a40a299f0972584490f6e/users/ec40d13187d14b5791cf206c71c9f963/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:37:59.307389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566c85d-e0f7-4ba1-951f-bbfd56cc6f9c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.307683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566c85d-e0f7-4ba1-951f-bbfd56cc6f9c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.308015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566c85d-e0f7-4ba1-951f-bbfd56cc6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.358341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e566c85d-e0f7-4ba1-951f-bbfd56cc6f9c None None] MFA Rules not processed for user `ec40d13187d14b5791cf206c71c9f963`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:37:59.359941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e566c85d-e0f7-4ba1-951f-bbfd56cc6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:37:59.415284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:59.518326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 870/1752] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:37:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:37:59.527019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:59.640040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467461b-a0d7-45db-ae97-1213c8e84993 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.647188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.648028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.648475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.648942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.649806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:59.654434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:59.707041 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566c85d-e0f7-4ba1-951f-bbfd56cc6f9c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:59.708435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 883/1753] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:37:59 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:59.726323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566c85d-e0f7-4ba1-951f-bbfd56cc6f9c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.866522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.868375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.869232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.870302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.871123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:59.874414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:59.914101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:59.924500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 871/1754] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:37:59 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:37:59.927971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15bcb4-95e3-4e0d-9beb-c7569d6247f8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.933562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.934263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.934692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.935180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.937028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:37:59.938813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:37:59.956249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:37:59.968969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 884/1755] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:37:59.970033 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee08d9-37eb-40cb-b699-3b3d72b547f8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:37:59.974643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:37:59.975445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:37:59.975723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:37:59.975992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] PATH_INFO: `/v3/projects/cb1a2767954e41c190ac0cef03389bd0/users/9b787fed349e4438a66a2232f67abeb8/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:37:59.997982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1a2767954e41c190ac0cef03389bd0, user_id=9b787fed349e4438a66a2232f67abeb8, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:00.001096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:00.021441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 872/1756] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:37:59 2022] PUT /identity/v3/projects/cb1a2767954e41c190ac0cef03389bd0/users/9b787fed349e4438a66a2232f67abeb8/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:00.029216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:00.054512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fed965-9518-4d5a-9f64-9d34236aae7a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:00.214792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd698-fd9f-4e24-882b-854456f0e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:00.216604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd698-fd9f-4e24-882b-854456f0e025 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:00.216800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd698-fd9f-4e24-882b-854456f0e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:00.217673 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd698-fd9f-4e24-882b-854456f0e025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:00.218467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fd698-fd9f-4e24-882b-854456f0e025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:00.220837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fd698-fd9f-4e24-882b-854456f0e025 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:00.244266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:00.260668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 885/1757] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:00.262173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b9882-3eae-49de-9b76-77a709b3571f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:00.278165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:00.279376 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:00.279660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:00.279957 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] PATH_INFO: `/v3/projects/cb1a2767954e41c190ac0cef03389bd0/users/9b787fed349e4438a66a2232f67abeb8/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:00.284135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1a2767954e41c190ac0cef03389bd0, user_id=9b787fed349e4438a66a2232f67abeb8, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:00.289454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:00.329558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:00.329842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:00.330220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:00.333170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 873/1758] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:00 2022] PUT /identity/v3/projects/cb1a2767954e41c190ac0cef03389bd0/users/9b787fed349e4438a66a2232f67abeb8/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:00.394916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] MFA Rules not processed for user `9b787fed349e4438a66a2232f67abeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:00.396807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:00.412087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:00.557860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:00.562578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:00.674482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 886/1759] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:00.683441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:00.686603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:00.772004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f62b-ba5b-49f3-b48f-3b1bb208bfac admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:00.789422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:00.800553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:00.800999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:00.802616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] PATH_INFO: `/v3/projects/f2b26d9e0259447cb0bacf92056fc83d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:00.808628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b26d9e0259447cb0bacf92056fc83d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:00.814392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:00.856439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:00.868493 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0498a-1eaf-4336-9375-ecacf463a644 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:00.874796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:00.876032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:00.876519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:00.876999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:00.891605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:00.895893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:00.910927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b26d9e0259447cb0bacf92056fc83d', 'request_id': 'req-9f66a855-0622-497c-a2bb-d9daebd8e255'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:00.921401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b26d9e0259447cb0bacf92056fc83d', 'request_id': 'req-9f66a855-0622-497c-a2bb-d9daebd8e255'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:00.923352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 887/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:00.929061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b26d9e0259447cb0bacf92056fc83d', 'request_id': 'req-9f66a855-0622-497c-a2bb-d9daebd8e255'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:00.947815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] The token cache is being invalidate because project f2b26d9e0259447cb0bacf92056fc83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:00.948589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:00.949585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:00.952539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 874/1761] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:00 2022] DELETE /identity/v3/projects/f2b26d9e0259447cb0bacf92056fc83d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:00.957288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:00.984131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2438e0-da15-4a6e-9c94-a8eed3eb5697 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:01.017816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:01.019883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:01.089065 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:01.089894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:01.090178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:01.090453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] PATH_INFO: `/v3/users/85b7a641bce8458caeda92791b2c2c48` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:01.093445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b7a641bce8458caeda92791b2c2c48)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:01.096072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:01.144050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66a855-0622-497c-a2bb-d9daebd8e255 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:01.148815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e4b6-3462-43c6-8260-fa42b6cea55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:01.149389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e4b6-3462-43c6-8260-fa42b6cea55c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:01.149667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e4b6-3462-43c6-8260-fa42b6cea55c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:01.149972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e4b6-3462-43c6-8260-fa42b6cea55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:01.160975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-05b8e4b6-3462-43c6-8260-fa42b6cea55c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:01.176276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b7a641bce8458caeda92791b2c2c48'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:01.180225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:01.195244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b7a641bce8458caeda92791b2c2c48'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:01.195244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b7a641bce8458caeda92791b2c2c48'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:01.217836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b7a641bce8458caeda92791b2c2c48'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:01.238729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b7a641bce8458caeda92791b2c2c48'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:01.255237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 888/1762] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:00 2022] DELETE /identity/v3/users/85b7a641bce8458caeda92791b2c2c48 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:01.281054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e4b6-3462-43c6-8260-fa42b6cea55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:01.283247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e4b6-3462-43c6-8260-fa42b6cea55c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:01.299583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 875/1763] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:02.110209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:02.111686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:02.208824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26ebe-6fa1-4a4e-b5d6-7a9fde1b2f00 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:02.215446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:02.218761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:02.219374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:02.219734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] PATH_INFO: `/v3/projects/7465b43261cb4d9bbbdc4dd8b8a728ff` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:02.221464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7465b43261cb4d9bbbdc4dd8b8a728ff)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:02.223696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:02.318965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7465b43261cb4d9bbbdc4dd8b8a728ff', 'request_id': 'req-e7122193-92f2-4cbb-8102-c0e07f45e4a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:02.333635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7465b43261cb4d9bbbdc4dd8b8a728ff', 'request_id': 'req-e7122193-92f2-4cbb-8102-c0e07f45e4a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:02.348428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7465b43261cb4d9bbbdc4dd8b8a728ff', 'request_id': 'req-e7122193-92f2-4cbb-8102-c0e07f45e4a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:02.363764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] The token cache is being invalidate because project 7465b43261cb4d9bbbdc4dd8b8a728ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:02.364799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:02.365570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e7122193-92f2-4cbb-8102-c0e07f45e4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:02.370974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 889/1764] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:02 2022] DELETE /identity/v3/projects/7465b43261cb4d9bbbdc4dd8b8a728ff => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:02.375161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7db8-bef7-4a89-a06a-7032453ae77f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:02.376003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7db8-bef7-4a89-a06a-7032453ae77f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:02.376448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7db8-bef7-4a89-a06a-7032453ae77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:02.399120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3eff7db8-bef7-4a89-a06a-7032453ae77f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:02.400348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3eff7db8-bef7-4a89-a06a-7032453ae77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:02.517180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 876/1765] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:02.525933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76d3a-7e99-4ef5-ba96-f1ff44c58e59 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:02.526217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76d3a-7e99-4ef5-ba96-f1ff44c58e59 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:02.526490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76d3a-7e99-4ef5-ba96-f1ff44c58e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:02.572641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-faf76d3a-7e99-4ef5-ba96-f1ff44c58e59 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:02.577557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-faf76d3a-7e99-4ef5-ba96-f1ff44c58e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:02.599409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 890/1766] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:02.603888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff7db8-bef7-4a89-a06a-7032453ae77f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:02.621719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff7db8-bef7-4a89-a06a-7032453ae77f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:02.637108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:02.638519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:02.638899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:02.639293 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:02.640096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:02.640501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:02.660272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:02.662673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:02.677283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 877/1767] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:02.682209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76d3a-7e99-4ef5-ba96-f1ff44c58e59 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:02.715031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76d3a-7e99-4ef5-ba96-f1ff44c58e59 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:02.721987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:02.722617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:02.722909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:02.723216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:02.723927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:02.725943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:02.791875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 891/1768] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:02 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:02.797262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:02.816191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b81d84-5f9c-4f5e-9726-4d7bcf826122 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:02.960549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848fa22-79a6-4c63-8943-bc5f59784311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:02.961236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848fa22-79a6-4c63-8943-bc5f59784311 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:02.961503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848fa22-79a6-4c63-8943-bc5f59784311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:02.962152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848fa22-79a6-4c63-8943-bc5f59784311 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:02.962479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848fa22-79a6-4c63-8943-bc5f59784311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:02.970340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848fa22-79a6-4c63-8943-bc5f59784311 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:03.041777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 878/1769] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:02 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:03.046104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:03.068652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ff195-795e-4f0c-a9ee-4ce9b4ff65a6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.068976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ff195-795e-4f0c-a9ee-4ce9b4ff65a6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.069713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ff195-795e-4f0c-a9ee-4ce9b4ff65a6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.073400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 879/1770] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:38:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:38:03.074220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10a188-0612-4b36-a655-af9f41ce838a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:03.082086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:03.084225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.084712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.085166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.086052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:03.088781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:03.102180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.102316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 892/1771] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:38:03.102850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.103341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.117748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:03.130901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfde02c-cfb3-4b9b-861a-acfae898e7f5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:03.136269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:03.136903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.137185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.137435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:03.137997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.138734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:03.140529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:03.142658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:03.152979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 893/1772] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:03.158288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:03.184000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843000f4-05f1-4468-a59f-5bac16091d77 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:03.201391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fe6b8-9790-4a60-8870-aebb8989dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:03.202233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe6b8-9790-4a60-8870-aebb8989dc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.205034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe6b8-9790-4a60-8870-aebb8989dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.205399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe6b8-9790-4a60-8870-aebb8989dc21 admin admin] PATH_INFO: `/v3/projects/b383dcbe5b4d4f7c8faa2a4634a1a378/users/0c890baa2bb04f97832f5eac07cb3b3e/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.214657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:03.248684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fe6b8-9790-4a60-8870-aebb8989dc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b383dcbe5b4d4f7c8faa2a4634a1a378, user_id=0c890baa2bb04f97832f5eac07cb3b3e, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:03.252156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fe6b8-9790-4a60-8870-aebb8989dc21 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:03.277025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 894/1773] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:03 2022] PUT /identity/v3/projects/b383dcbe5b4d4f7c8faa2a4634a1a378/users/0c890baa2bb04f97832f5eac07cb3b3e/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:03.290562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a497de-ad64-4f32-9ddc-5cbd577c5ef2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.291347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a497de-ad64-4f32-9ddc-5cbd577c5ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.291768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a497de-ad64-4f32-9ddc-5cbd577c5ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.359777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 880/1774] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:38:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:03.363707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-50a497de-ad64-4f32-9ddc-5cbd577c5ef2 None None] MFA Rules not processed for user `0c890baa2bb04f97832f5eac07cb3b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:03.365398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-50a497de-ad64-4f32-9ddc-5cbd577c5ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:03.520172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:03.522232 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:03.534527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 895/1775] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:03.539792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a497de-ad64-4f32-9ddc-5cbd577c5ef2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:03.555162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67150d-ff64-47cb-bcf0-de86d4d148b5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:03.756478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a497de-ad64-4f32-9ddc-5cbd577c5ef2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:03.768229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:03.773934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.774394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.776894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.779404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:03.784528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:03.785456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:03.786591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.787229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.787642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.801579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:03.803304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:03.811316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:03.835657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 881/1776] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:03.850312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 896/1777] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:03 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:03.852415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:03.869332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54010fc-fec5-4785-acea-1484f87778f5 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:03.957594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:03.958146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:03.958594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:03.959142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:03.960048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:03.962211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:03.987377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 882/1778] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:03 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:03.992073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:04.003930 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0047e-4d88-4f20-be72-3d5a6c99a385 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:04.008865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:04.009560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:04.009911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:04.010315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:04.011114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:04.013379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:04.026068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 897/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:04.029984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:04.041202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f30da-7b50-40ca-89ba-80bb65c6cb43 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:04.046125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:04.046825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:04.047149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:04.047415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] PATH_INFO: `/v3/projects/bd1357b83d304fc7ba7e8fa92d10c814/users/00b655e9527f40af8a4f2ab7b913116b/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:04.067170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1357b83d304fc7ba7e8fa92d10c814, user_id=00b655e9527f40af8a4f2ab7b913116b, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:04.070012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:04.097788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 883/1780] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:04 2022] PUT /identity/v3/projects/bd1357b83d304fc7ba7e8fa92d10c814/users/00b655e9527f40af8a4f2ab7b913116b/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:04.100054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:04.115429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c773b-bb22-4012-a982-45ab0c90efea admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:04.171630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:04.192220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffe7e-eed6-4864-b923-c0fcbc59d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:04.193302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffe7e-eed6-4864-b923-c0fcbc59d2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:04.193302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffe7e-eed6-4864-b923-c0fcbc59d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:04.193614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffe7e-eed6-4864-b923-c0fcbc59d2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:04.194399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffe7e-eed6-4864-b923-c0fcbc59d2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:04.196319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffe7e-eed6-4864-b923-c0fcbc59d2ce admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:04.207998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 898/1781] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:04.213044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:04.232356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1037a-bc14-435e-a2fe-48c03204462c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:04.240045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:04.240842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:04.241198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:04.241585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] PATH_INFO: `/v3/projects/bd1357b83d304fc7ba7e8fa92d10c814/users/00b655e9527f40af8a4f2ab7b913116b/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:04.245556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1357b83d304fc7ba7e8fa92d10c814, user_id=00b655e9527f40af8a4f2ab7b913116b, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:04.249273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:04.271189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 884/1782] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:04 2022] PUT /identity/v3/projects/bd1357b83d304fc7ba7e8fa92d10c814/users/00b655e9527f40af8a4f2ab7b913116b/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:04.273890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b9fcc-1a6d-4a6f-b9c0-d4e9d0c55c27 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:04.274322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b9fcc-1a6d-4a6f-b9c0-d4e9d0c55c27 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:04.274994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b9fcc-1a6d-4a6f-b9c0-d4e9d0c55c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:04.307541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9e4b9fcc-1a6d-4a6f-b9c0-d4e9d0c55c27 None None] MFA Rules not processed for user `00b655e9527f40af8a4f2ab7b913116b`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:04.308991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9e4b9fcc-1a6d-4a6f-b9c0-d4e9d0c55c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:04.426813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 899/1783] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:04.441378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:04.443171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:04.545777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d9fc3-a42e-45c4-af1f-f1699ee07c0c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:04.550422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61487-eed1-4705-8d51-e9a08a6a3895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:04.551163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61487-eed1-4705-8d51-e9a08a6a3895 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:04.551632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61487-eed1-4705-8d51-e9a08a6a3895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:04.551910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61487-eed1-4705-8d51-e9a08a6a3895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:04.571090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61487-eed1-4705-8d51-e9a08a6a3895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:04.572909 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61487-eed1-4705-8d51-e9a08a6a3895 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:04.586572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 885/1784] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:05.293985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b9fcc-1a6d-4a6f-b9c0-d4e9d0c55c27 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:05.423670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b9fcc-1a6d-4a6f-b9c0-d4e9d0c55c27 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:05.435456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:05.436404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:05.436832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:05.437300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] PATH_INFO: `/v3/users/0c890baa2bb04f97832f5eac07cb3b3e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:05.446665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c890baa2bb04f97832f5eac07cb3b3e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:05.459630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:05.554180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c890baa2bb04f97832f5eac07cb3b3e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.564004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c890baa2bb04f97832f5eac07cb3b3e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.564737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c890baa2bb04f97832f5eac07cb3b3e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.579188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c890baa2bb04f97832f5eac07cb3b3e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.588082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:05.615055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c890baa2bb04f97832f5eac07cb3b3e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.629596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:05.631116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:05.631244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 900/1785] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:05 2022] DELETE /identity/v3/users/0c890baa2bb04f97832f5eac07cb3b3e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:05.631743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:05.656670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:05.657873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:05.719075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:05.720746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:05.725596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:05.741218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 886/1786] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:05.750998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:05.752692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:05.800455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878276-dc16-4b58-b519-f2366d9c9dca admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:05.806988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:05.807946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:05.808441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:05.808860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] PATH_INFO: `/v3/users/ec40d13187d14b5791cf206c71c9f963` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:05.811079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec40d13187d14b5791cf206c71c9f963)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:05.813400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:05.835204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba61c7c-9d08-4a6b-bfd3-9ebb9d982fb3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:05.840410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7a459-48c2-47bf-b556-cbc6b8bb59e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:05.842710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a459-48c2-47bf-b556-cbc6b8bb59e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:05.843137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a459-48c2-47bf-b556-cbc6b8bb59e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:05.843661 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a459-48c2-47bf-b556-cbc6b8bb59e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:05.855037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7a459-48c2-47bf-b556-cbc6b8bb59e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:05.857961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7a459-48c2-47bf-b556-cbc6b8bb59e9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:05.868989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 887/1787] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:05.874678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec40d13187d14b5791cf206c71c9f963'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.885072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec40d13187d14b5791cf206c71c9f963'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.885598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec40d13187d14b5791cf206c71c9f963'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.897871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec40d13187d14b5791cf206c71c9f963'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.915165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec40d13187d14b5791cf206c71c9f963'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:05.925721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 901/1788] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:05 2022] DELETE /identity/v3/users/ec40d13187d14b5791cf206c71c9f963 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:05.928758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:05.929217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:05.929504 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:05.964740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:05.967475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:06.097971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 888/1789] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:06.174180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:06.174314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:06.176308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:06.176450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:06.195613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58016dd9-d6ea-4334-ac0b-96956f5a9556 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:06.203725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:06.204775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:06.205577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:06.206008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] PATH_INFO: `/v3/users/2de9807d5cc046eeb55e5cdbc258d5d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:06.208264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de9807d5cc046eeb55e5cdbc258d5d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:06.213779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:06.313232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613926ab-7d66-4a0a-94f7-4bba7cb7be92 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:06.317945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de9807d5cc046eeb55e5cdbc258d5d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.319022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de9807d5cc046eeb55e5cdbc258d5d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.319168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4341955-3635-421f-9c14-173203852835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:06.319821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341955-3635-421f-9c14-173203852835 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:06.320275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341955-3635-421f-9c14-173203852835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:06.320553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341955-3635-421f-9c14-173203852835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:06.335619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de9807d5cc046eeb55e5cdbc258d5d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.341139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4341955-3635-421f-9c14-173203852835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:06.343658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4341955-3635-421f-9c14-173203852835 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:06.354110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de9807d5cc046eeb55e5cdbc258d5d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.355985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de9807d5cc046eeb55e5cdbc258d5d1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.356853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 902/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:06.389083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 889/1791] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:06 2022] DELETE /identity/v3/users/2de9807d5cc046eeb55e5cdbc258d5d1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:06.397993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:06.398506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:06.399428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:06.460397 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:06.463965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:06.476314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:06.630409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 903/1792] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:06.658193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:06.661422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:06.680304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:06.766426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0ea3-707e-4a73-a32f-ab6983aabea7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:06.770963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:06.771772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:06.772120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:06.772465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:06.784495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:06.786194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:06.786726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:06.788272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:06.800249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 890/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:06.810034 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cb7fd-f348-4ba3-9e56-2edca9e8abbf None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:06.823761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:06.825893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:06.826250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:06.827213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] PATH_INFO: `/v3/projects/b383dcbe5b4d4f7c8faa2a4634a1a378` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:06.831235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b383dcbe5b4d4f7c8faa2a4634a1a378)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:06.833464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:06.929711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b383dcbe5b4d4f7c8faa2a4634a1a378', 'request_id': 'req-dd1abde0-114b-4d12-a587-2d5486fafc94'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.935781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b383dcbe5b4d4f7c8faa2a4634a1a378', 'request_id': 'req-dd1abde0-114b-4d12-a587-2d5486fafc94'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.950686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b383dcbe5b4d4f7c8faa2a4634a1a378', 'request_id': 'req-dd1abde0-114b-4d12-a587-2d5486fafc94'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.966690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] The token cache is being invalidate because project b383dcbe5b4d4f7c8faa2a4634a1a378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:06.967431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.968274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:06.970458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 904/1794] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:06 2022] DELETE /identity/v3/projects/b383dcbe5b4d4f7c8faa2a4634a1a378 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:06.975254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:06.987858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4cbd4-dfe8-4ad1-b3ce-38593a61c592 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:07.062964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:07.063797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:07.064153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:07.064501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] PATH_INFO: `/v3/users/00b655e9527f40af8a4f2ab7b913116b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:07.066055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b655e9527f40af8a4f2ab7b913116b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:07.068333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:07.132648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b655e9527f40af8a4f2ab7b913116b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.133652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b655e9527f40af8a4f2ab7b913116b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.148015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b655e9527f40af8a4f2ab7b913116b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.160599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b655e9527f40af8a4f2ab7b913116b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.161947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b655e9527f40af8a4f2ab7b913116b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.192370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 891/1795] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:06 2022] DELETE /identity/v3/users/00b655e9527f40af8a4f2ab7b913116b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:07.582561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:07.586307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:07.630269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1abde0-114b-4d12-a587-2d5486fafc94 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:07.687038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:07.688729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:07.738868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:07.756668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:07.757339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:07.758016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:07.758302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] PATH_INFO: `/v3/projects/fb151b996d9a40a299f0972584490f6e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:07.759747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb151b996d9a40a299f0972584490f6e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:07.761746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:07.776178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9b722-6ecc-4d62-bb8b-304cf7fc153e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:07.781616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:07.782533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:07.782820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:07.783128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] PATH_INFO: `/v3/projects/6d0b3fde6aeb4b5e8ffafa252b39a803` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:07.784704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0b3fde6aeb4b5e8ffafa252b39a803)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:07.786674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:07.805847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:07.819764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb151b996d9a40a299f0972584490f6e', 'request_id': 'req-26cf1e33-40dc-42b0-b93f-8db7e8d00574'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.826710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb151b996d9a40a299f0972584490f6e', 'request_id': 'req-26cf1e33-40dc-42b0-b93f-8db7e8d00574'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.839178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb151b996d9a40a299f0972584490f6e', 'request_id': 'req-26cf1e33-40dc-42b0-b93f-8db7e8d00574'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.847752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0b3fde6aeb4b5e8ffafa252b39a803', 'request_id': 'req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.853057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] The token cache is being invalidate because project fb151b996d9a40a299f0972584490f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:07.853350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.859958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.860177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0b3fde6aeb4b5e8ffafa252b39a803', 'request_id': 'req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.860260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 905/1796] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:07 2022] DELETE /identity/v3/projects/fb151b996d9a40a299f0972584490f6e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:07.860733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:07.862468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:07.863258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0b3fde6aeb4b5e8ffafa252b39a803', 'request_id': 'req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.884293 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] The token cache is being invalidate because project 6d0b3fde6aeb4b5e8ffafa252b39a803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:07.884678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.885644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:07.888278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 892/1797] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:07 2022] DELETE /identity/v3/projects/6d0b3fde6aeb4b5e8ffafa252b39a803 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:07.889349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:07.891317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:07.944008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf1e33-40dc-42b0-b93f-8db7e8d00574 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:07.973769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a54bf-ac1c-4c77-b7e3-963abb1853cc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:07.978709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:07.979400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:07.979682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:07.979953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] PATH_INFO: `/v3/projects/bd1357b83d304fc7ba7e8fa92d10c814` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:07.982993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1357b83d304fc7ba7e8fa92d10c814)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:07.984982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.011830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.013161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.013476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.013752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] PATH_INFO: `/v3/users/9b787fed349e4438a66a2232f67abeb8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.015182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b787fed349e4438a66a2232f67abeb8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.017111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.039326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1357b83d304fc7ba7e8fa92d10c814', 'request_id': 'req-1e86bffd-644b-4af3-bf95-10a6802c432b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.047302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1357b83d304fc7ba7e8fa92d10c814', 'request_id': 'req-1e86bffd-644b-4af3-bf95-10a6802c432b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.054096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1357b83d304fc7ba7e8fa92d10c814', 'request_id': 'req-1e86bffd-644b-4af3-bf95-10a6802c432b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.056874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:08.070460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] The token cache is being invalidate because project bd1357b83d304fc7ba7e8fa92d10c814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:08.071549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.072310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.074040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 893/1798] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:07 2022] DELETE /identity/v3/projects/bd1357b83d304fc7ba7e8fa92d10c814 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:08.077198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b787fed349e4438a66a2232f67abeb8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.079838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:08.082817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:08.086538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b787fed349e4438a66a2232f67abeb8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.087278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b787fed349e4438a66a2232f67abeb8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.104313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b787fed349e4438a66a2232f67abeb8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.113282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:08.120182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2053cb43-72ab-47df-a8d3-0ffca9895b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b787fed349e4438a66a2232f67abeb8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.129718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 906/1799] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:07 2022] DELETE /identity/v3/users/9b787fed349e4438a66a2232f67abeb8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:08.131097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897612e-603a-481c-a930-e890baa0989f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.131388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897612e-603a-481c-a930-e890baa0989f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.131667 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897612e-603a-481c-a930-e890baa0989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.162485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e897612e-603a-481c-a930-e890baa0989f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:08.163807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e897612e-603a-481c-a930-e890baa0989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:08.165817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86bffd-644b-4af3-bf95-10a6802c432b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:08.242259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.243914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.244685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.245077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] PATH_INFO: `/v3/users/0e6d57c04c244156b55c181535363aa0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.246475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6d57c04c244156b55c181535363aa0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.250819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.278986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 907/1800] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:08.284278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93430f-f983-4da8-a28a-b9555cf6afbd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.284853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93430f-f983-4da8-a28a-b9555cf6afbd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.285283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93430f-f983-4da8-a28a-b9555cf6afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.325304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9a93430f-f983-4da8-a28a-b9555cf6afbd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:08.327149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9a93430f-f983-4da8-a28a-b9555cf6afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:08.343810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 908/1801] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:08.345627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93430f-f983-4da8-a28a-b9555cf6afbd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:08.349908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6d57c04c244156b55c181535363aa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.351779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6d57c04c244156b55c181535363aa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.377768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93430f-f983-4da8-a28a-b9555cf6afbd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:08.382741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6d57c04c244156b55c181535363aa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.391486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.392552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.393083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.393263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.393978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:08.394286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.396383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.398952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6d57c04c244156b55c181535363aa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.399710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6d57c04c244156b55c181535363aa0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.422979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 909/1802] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:08.427080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:08.432072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:08.433667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 894/1803] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:08 2022] DELETE /identity/v3/users/0e6d57c04c244156b55c181535363aa0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:08.457322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab83cf0-27a0-4f76-82ed-2929f744c824 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:08.542827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.543602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.543931 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.544219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.545078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.547059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.587017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 910/1804] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:08 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:08.591927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:08.608051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b08193-5aa2-4582-a6d0-53ffcce0f1d0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:08.643677 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:08.712234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.713327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.713778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.714140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.714843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.718464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.726468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:08.728193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:08.752610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8371b7-e307-4b98-b892-e4cedce6d9e7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:08.765907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 895/1805] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:08 2022] POST /identity/v3/users => generated 281 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:08.766299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.766961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.767262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.767523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] PATH_INFO: `/v3/projects/cb1a2767954e41c190ac0cef03389bd0` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.768830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1a2767954e41c190ac0cef03389bd0)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.770662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:08.777151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.790436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b99d8-3a0e-4aaf-8b5b-15b721c32819 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:08.802386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.806958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.807383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.807666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.808414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.812356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:08.833756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 896/1806] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:08.837974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:08.867429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c352-b523-4d6c-8614-07bdc3cc598e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:08.880223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1a2767954e41c190ac0cef03389bd0', 'request_id': 'req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.884928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:08.900800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1a2767954e41c190ac0cef03389bd0', 'request_id': 'req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.921309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1a2767954e41c190ac0cef03389bd0', 'request_id': 'req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.940538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] The token cache is being invalidate because project cb1a2767954e41c190ac0cef03389bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:08.940840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.942022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-e5fe2fbf-5ba6-4d1e-a28e-9beda1d6f267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:08.949260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 911/1807] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:08 2022] DELETE /identity/v3/projects/cb1a2767954e41c190ac0cef03389bd0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:08.951446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc19f-3c24-41b9-bfce-8c45cb991b33 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.951737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc19f-3c24-41b9-bfce-8c45cb991b33 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.952012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc19f-3c24-41b9-bfce-8c45cb991b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.980126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c02cc19f-3c24-41b9-bfce-8c45cb991b33 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:08.981371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c02cc19f-3c24-41b9-bfce-8c45cb991b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:08.991240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:08.992205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:08.992205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:08.992791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:08.993554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:08.995844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.010783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 897/1808] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:09.011827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.014645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.051053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea459f-4ab6-4cb4-9294-261d518cf581 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.056815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.057509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.057792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.058067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] PATH_INFO: `/v3/projects/ad06aa2ced804731b20ebe86c2f005c6/users/c0967d9069684577814f5cb7571c3079/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.078974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 912/1809] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:09.083117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad06aa2ced804731b20ebe86c2f005c6, user_id=c0967d9069684577814f5cb7571c3079, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.086841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.092443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec77f6-771c-4d89-ab6a-a0a108b1935a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.092718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec77f6-771c-4d89-ab6a-a0a108b1935a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.093205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec77f6-771c-4d89-ab6a-a0a108b1935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.111174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 898/1810] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:09 2022] PUT /identity/v3/projects/ad06aa2ced804731b20ebe86c2f005c6/users/c0967d9069684577814f5cb7571c3079/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:09.112193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.114185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.132840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-02ec77f6-771c-4d89-ab6a-a0a108b1935a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:09.134970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-02ec77f6-771c-4d89-ab6a-a0a108b1935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.195481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e9ba-a9fc-452c-b6ee-09970d6e3be6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.200409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.201057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.201330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.201598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] PATH_INFO: `/v3/projects/132661b021cf4489bbf0d37f4e442ab1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.203571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132661b021cf4489bbf0d37f4e442ab1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.205500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.209959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 913/1811] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:09.211322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a400a-40e5-42ae-a49d-4526cb60ca2e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.211682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a400a-40e5-42ae-a49d-4526cb60ca2e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.212028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a400a-40e5-42ae-a49d-4526cb60ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.224271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:09.269197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-967a400a-40e5-42ae-a49d-4526cb60ca2e None None] MFA Rules not processed for user `c0967d9069684577814f5cb7571c3079`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:09.273761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-967a400a-40e5-42ae-a49d-4526cb60ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.275842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132661b021cf4489bbf0d37f4e442ab1', 'request_id': 'req-b9e92d40-2c36-44dc-8040-18db5def0044'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:09.285065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132661b021cf4489bbf0d37f4e442ab1', 'request_id': 'req-b9e92d40-2c36-44dc-8040-18db5def0044'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:09.303931 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132661b021cf4489bbf0d37f4e442ab1', 'request_id': 'req-b9e92d40-2c36-44dc-8040-18db5def0044'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:09.329955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] The token cache is being invalidate because project 132661b021cf4489bbf0d37f4e442ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:09.330345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:09.331094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:09.333129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 899/1812] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:09 2022] DELETE /identity/v3/projects/132661b021cf4489bbf0d37f4e442ab1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:09.333967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.335397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.407728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 914/1813] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:09.409257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34284ae-af53-4b52-ad39-19a561c7ed9a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.409551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34284ae-af53-4b52-ad39-19a561c7ed9a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.409848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34284ae-af53-4b52-ad39-19a561c7ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.424521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e92d40-2c36-44dc-8040-18db5def0044 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.456832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.457856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.458324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.458783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.459758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:09.460568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.462417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.474641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d34284ae-af53-4b52-ad39-19a561c7ed9a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:09.476296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d34284ae-af53-4b52-ad39-19a561c7ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.487990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 915/1814] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:09.496110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc12b2c-68a2-419b-a181-04638d353dcf None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.496392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc12b2c-68a2-419b-a181-04638d353dcf None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.496973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc12b2c-68a2-419b-a181-04638d353dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.500786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 900/1815] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:09.502510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.510670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:09.515914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf07b1-9c8f-4e70-a77c-67f2857e2878 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.529144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cbc12b2c-68a2-419b-a181-04638d353dcf None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:09.531087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.531914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.532198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.532414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cbc12b2c-68a2-419b-a181-04638d353dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.532633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.533410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.535209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.543235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 916/1816] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:09.549894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc12b2c-68a2-419b-a181-04638d353dcf None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.561903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc12b2c-68a2-419b-a181-04638d353dcf None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.567469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.568123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.568405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.568807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.570201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:09.570514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.572252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.587606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 901/1817] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:09.592679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.596018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 917/1818] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:09.600368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.611402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf761a-6c49-4594-9c3d-cd58a6b4531b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.688645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df6844-e60a-4d9b-ab8b-ed6e155495a8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.690441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.691130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.691541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.691820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.692716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.695263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.705964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.706472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.706819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.707069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.708037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.710032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.732131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 918/1819] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:09.733168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.735073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.742851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 902/1820] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:09.743830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.749410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:09.755197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf358f-2d45-450d-bf90-f733f51cac38 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.813876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f204-ec86-480c-8cdd-477b53a246d7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.818229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.819046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.819431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.819912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.836977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.837626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.837876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.838412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.839220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.841399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.868631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 903/1821] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:09 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:09.869518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.881091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa1d41-2872-46bd-95e4-837d656d30f2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.887749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.888370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.888776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.889063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.889745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.891883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.907747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 904/1822] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:09.911876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.913310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.914912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.923860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1b35-f8d2-4784-bc33-f33fe97c2c16 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.926148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 919/1823] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:09.926802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.938647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f8ea-a83d-403e-8092-b4655d9f75b2 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.939163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.940355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.940728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.942152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.943096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.944836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.945800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.946907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.946907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.947110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.947718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.949318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.957931 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 905/1824] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:09.960537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 920/1825] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:09.961303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.963252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:09.964787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:09.976843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4b626-5f3a-4b29-82f5-8818da3567ac admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.978001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116492c-1a82-472e-9227-bcf83c4dae40 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:09.983304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.983555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:09.983990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.984194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:09.984379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.984487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:09.984673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] PATH_INFO: `/v3/projects/b8c2f1534d89420c8c3ba021be030974/users/744275e5171a42f79da0771ce00655a9/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.984774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] PATH_INFO: `/v3/users/c0967d9069684577814f5cb7571c3079` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:09.985885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0967d9069684577814f5cb7571c3079)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:09.988026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:09.993891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:10.003249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c2f1534d89420c8c3ba021be030974, user_id=744275e5171a42f79da0771ce00655a9, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.006085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.024318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 906/1826] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:09 2022] PUT /identity/v3/projects/b8c2f1534d89420c8c3ba021be030974/users/744275e5171a42f79da0771ce00655a9/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:10.025721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.051485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0967d9069684577814f5cb7571c3079'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:10.061294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0967d9069684577814f5cb7571c3079'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:10.062045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0967d9069684577814f5cb7571c3079'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:10.073849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0967d9069684577814f5cb7571c3079'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:10.093112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7164c958-c302-4329-8e41-c94eca3e0a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0967d9069684577814f5cb7571c3079'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:10.100749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 921/1827] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:09 2022] DELETE /identity/v3/users/c0967d9069684577814f5cb7571c3079 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:10.101933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf361591-76ab-4485-bfd0-580fc0c42c39 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.102218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf361591-76ab-4485-bfd0-580fc0c42c39 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.102488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf361591-76ab-4485-bfd0-580fc0c42c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.131882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9eaa7-33a4-4f2b-b781-e195afb75115 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.157292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bf361591-76ab-4485-bfd0-580fc0c42c39 None None] MFA Rules not processed for user `744275e5171a42f79da0771ce00655a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:10.159027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bf361591-76ab-4485-bfd0-580fc0c42c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:10.202114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:10.230895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.235460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.235856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.236148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.237020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.243845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.245264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 922/1828] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:10.251611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.251985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.252267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.264303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 907/1829] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:10.265092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.267275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:10.282777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:10.284132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:10.293159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2187a5-c3be-4cd6-ad01-b33dfdf1798e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.295820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 923/1830] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:10.296656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.298763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:10.302945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.303669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.304016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.304363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.305220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.307471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.312093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085f97b-ad06-4f1a-9c58-8959e2b16484 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.317610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.318555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.318900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.319271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] PATH_INFO: `/v3/projects/5ae19ec999e44f5d9e8dc77bfc246d6e/users/2b7286f017604c55901b5b32d5bad5c4/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.343165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae19ec999e44f5d9e8dc77bfc246d6e, user_id=2b7286f017604c55901b5b32d5bad5c4, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.346160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.349643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 908/1831] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:10.350672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.352964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:10.386875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 924/1832] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:10 2022] PUT /identity/v3/projects/5ae19ec999e44f5d9e8dc77bfc246d6e/users/2b7286f017604c55901b5b32d5bad5c4/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:10.398635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.473500 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4fff-995f-4e5b-a3ef-4d6371aefd01 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.504591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:10.539169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c16c55-82a2-4836-91ae-b24b72c0d01b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.542806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b25f8-ef3c-4599-af92-5298dc8fd78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.544297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b25f8-ef3c-4599-af92-5298dc8fd78c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.544503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b25f8-ef3c-4599-af92-5298dc8fd78c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.544787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b25f8-ef3c-4599-af92-5298dc8fd78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.546949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.547884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.548605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.548955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.550566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.552974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.555674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b25f8-ef3c-4599-af92-5298dc8fd78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.557301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b25f8-ef3c-4599-af92-5298dc8fd78c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.571805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 909/1833] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:10.573546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3005309-27aa-409c-831f-fae8df4ee67d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.573912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3005309-27aa-409c-831f-fae8df4ee67d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.574259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3005309-27aa-409c-831f-fae8df4ee67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.580937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 925/1834] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:10.585144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.600134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011525-6dc8-4f39-8022-fc1d1a48e86a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.607688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.609049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.609869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.610223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.611107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.612787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.622664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a3005309-27aa-409c-831f-fae8df4ee67d None None] MFA Rules not processed for user `2b7286f017604c55901b5b32d5bad5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:10.624127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3005309-27aa-409c-831f-fae8df4ee67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:10.625905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 926/1835] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:10.630296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.643333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca811fc-ad99-4a8c-a85b-2e8f59f6b886 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.648900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.649553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.649836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.650110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.650807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.652536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.664851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 927/1836] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:38:10.669634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.680570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765483-4ac9-4956-9ce0-af54b58a79ce admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.686509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba2262-ccba-49bd-9500-2d0c94c65e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.687230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba2262-ccba-49bd-9500-2d0c94c65e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.687533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba2262-ccba-49bd-9500-2d0c94c65e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.687805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba2262-ccba-49bd-9500-2d0c94c65e05 admin admin] PATH_INFO: `/v3/projects/f1f1291f2db94400a4ff9ddc7aaaa6de/users/92578f078ed34f3da6ac2ff98448a705/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.705679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba2262-ccba-49bd-9500-2d0c94c65e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f1291f2db94400a4ff9ddc7aaaa6de, user_id=92578f078ed34f3da6ac2ff98448a705, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.708554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba2262-ccba-49bd-9500-2d0c94c65e05 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.713799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 910/1837] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:10.719206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3005309-27aa-409c-831f-fae8df4ee67d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.731040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 928/1838] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:10 2022] PUT /identity/v3/projects/f1f1291f2db94400a4ff9ddc7aaaa6de/users/92578f078ed34f3da6ac2ff98448a705/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:10.731275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3005309-27aa-409c-831f-fae8df4ee67d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.738975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c958b0-6b5a-4ac6-8cec-c7391d570d90 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.739413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c958b0-6b5a-4ac6-8cec-c7391d570d90 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.740489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c958b0-6b5a-4ac6-8cec-c7391d570d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.744780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:10.773196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-14c958b0-6b5a-4ac6-8cec-c7391d570d90 None None] MFA Rules not processed for user `92578f078ed34f3da6ac2ff98448a705`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:10.774438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-14c958b0-6b5a-4ac6-8cec-c7391d570d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:10.804145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.804706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.804991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.805269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.805927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.807976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.844287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 911/1839] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:10.848099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 929/1840] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:10.852547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c958b0-6b5a-4ac6-8cec-c7391d570d90 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.855625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:10.864141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c958b0-6b5a-4ac6-8cec-c7391d570d90 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.962279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.963112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.963392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.963665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.964399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.968902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413d68-e8c4-49de-ab44-96c6fe0ae6e6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:10.973415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:10.974856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:10.975577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:10.975860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:10.976134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:10.976960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:10.978750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.014468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:11.028639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 930/1841] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:11.030138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.031590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 912/1842] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:10 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:11.032621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:11.035970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.049013 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c258b-a402-42f4-95f5-458f26cf50ac admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.107095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76417fe4-f149-40b3-b6a9-4995b09c0912 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.111806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.112452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.112731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.112999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] PATH_INFO: `/v3/projects/ad06aa2ced804731b20ebe86c2f005c6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.114134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad06aa2ced804731b20ebe86c2f005c6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.114847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.115550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.115835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.116080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.116180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.116757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.118729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.142354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 913/1843] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:11 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:11.143256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.156097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916b2e0-46b9-4eff-9fdb-4d7498f49799 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.170740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad06aa2ced804731b20ebe86c2f005c6', 'request_id': 'req-8d91ba0e-8aab-49b9-af19-3b09da9a8337'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:11.174775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:11.176479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad06aa2ced804731b20ebe86c2f005c6', 'request_id': 'req-8d91ba0e-8aab-49b9-af19-3b09da9a8337'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:11.186438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad06aa2ced804731b20ebe86c2f005c6', 'request_id': 'req-8d91ba0e-8aab-49b9-af19-3b09da9a8337'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:11.203025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] The token cache is being invalidate because project ad06aa2ced804731b20ebe86c2f005c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:11.203313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:11.203982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:11.205850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 931/1844] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:11 2022] DELETE /identity/v3/projects/ad06aa2ced804731b20ebe86c2f005c6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:11.206472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.207825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:11.228643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456236f-525e-4e45-875c-b09f746326ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.229279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456236f-525e-4e45-875c-b09f746326ab admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.229566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456236f-525e-4e45-875c-b09f746326ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.229851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456236f-525e-4e45-875c-b09f746326ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.231082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456236f-525e-4e45-875c-b09f746326ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.232742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456236f-525e-4e45-875c-b09f746326ab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.246819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 914/1845] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:11.246819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.246819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.246819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.265942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:11.267204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:11.275757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 915/1846] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:11.276541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.277939 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:11.301344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2c3c-b44f-4485-a0de-2029ec44dca8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.311706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.312934 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.313222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.313507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] PATH_INFO: `/v3/projects/a753f4b60b7842288a87925c1cc1f574/users/e4be0e903a404b2ebddf9a18f09362d3/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.328790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91ba0e-8aab-49b9-af19-3b09da9a8337 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.334607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0aafe-3061-4de8-bb48-1902d7d280af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.335296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0aafe-3061-4de8-bb48-1902d7d280af admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.335578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0aafe-3061-4de8-bb48-1902d7d280af admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.335857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0aafe-3061-4de8-bb48-1902d7d280af admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.336809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0aafe-3061-4de8-bb48-1902d7d280af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.338619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0aafe-3061-4de8-bb48-1902d7d280af admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.357429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 932/1847] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:11.357429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c08b2-ea57-4eb3-a1b4-a6286cce2931 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.357429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c08b2-ea57-4eb3-a1b4-a6286cce2931 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.357429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c08b2-ea57-4eb3-a1b4-a6286cce2931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.360542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a753f4b60b7842288a87925c1cc1f574, user_id=e4be0e903a404b2ebddf9a18f09362d3, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.364944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.386116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fe2c08b2-ea57-4eb3-a1b4-a6286cce2931 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:11.388314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 916/1848] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:11 2022] PUT /identity/v3/projects/a753f4b60b7842288a87925c1cc1f574/users/e4be0e903a404b2ebddf9a18f09362d3/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:11.389196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fe2c08b2-ea57-4eb3-a1b4-a6286cce2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:11.389648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.416295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:11.474501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b0476-ec34-4ae0-9fd3-919c41fbff48 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.479910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.480621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.480868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.481325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] PATH_INFO: `/v3/projects/9af50753690d4501984c9ef83ee9205e/users/5b18be10af9d4fa9868434ebecaa0249/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.483609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 933/1849] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:11.484293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c08b2-ea57-4eb3-a1b4-a6286cce2931 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.501841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c08b2-ea57-4eb3-a1b4-a6286cce2931 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.509718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af50753690d4501984c9ef83ee9205e, user_id=5b18be10af9d4fa9868434ebecaa0249, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.512086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.513305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.513581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.513689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.513900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.514601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.516608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.534532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 934/1850] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:11.535339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.546224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333065e-4a0a-456d-ab15-2894b51fc749 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.554027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 917/1851] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:11 2022] PUT /identity/v3/projects/9af50753690d4501984c9ef83ee9205e/users/5b18be10af9d4fa9868434ebecaa0249/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:11.554969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.630038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.630815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.631215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.631582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.632604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:11.633068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.635174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.646329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5288-387b-470e-9149-6fdc26e7d29e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.652047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.653407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.653871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.654308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] PATH_INFO: `/v3/projects/a753f4b60b7842288a87925c1cc1f574/users/e4be0e903a404b2ebddf9a18f09362d3/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.656710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a753f4b60b7842288a87925c1cc1f574, user_id=e4be0e903a404b2ebddf9a18f09362d3, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.657205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 935/1852] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:11.658381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.660379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.672598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58269-2134-4e2e-a083-c2f74fbd2d66 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.685255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bf38-8ecd-481d-b73e-683b5157553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.685931 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bf38-8ecd-481d-b73e-683b5157553f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.686431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bf38-8ecd-481d-b73e-683b5157553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.686704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bf38-8ecd-481d-b73e-683b5157553f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.687509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bf38-8ecd-481d-b73e-683b5157553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.689729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bf38-8ecd-481d-b73e-683b5157553f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.692430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 918/1853] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:11 2022] PUT /identity/v3/projects/a753f4b60b7842288a87925c1cc1f574/users/e4be0e903a404b2ebddf9a18f09362d3/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:11.702549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 936/1854] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:11.704843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239b60-bf21-4e66-93e7-cbbe73061ad0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.705263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239b60-bf21-4e66-93e7-cbbe73061ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.705542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239b60-bf21-4e66-93e7-cbbe73061ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.705917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.726630 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:11.749422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-99239b60-bf21-4e66-93e7-cbbe73061ad0 None None] MFA Rules not processed for user `e4be0e903a404b2ebddf9a18f09362d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:11.751245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-99239b60-bf21-4e66-93e7-cbbe73061ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:11.852498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049522-6343-41e3-81f2-feb0a43def75 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.867794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:11.868458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:11.868743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:11.869019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:11.869704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:11.873308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:11.913496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 919/1855] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:11 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:11.914408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.924754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 937/1856] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 31 18:38:11.929625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239b60-bf21-4e66-93e7-cbbe73061ad0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:11.944374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239b60-bf21-4e66-93e7-cbbe73061ad0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:11.972631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:12.004833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444a55-98c8-4519-902c-34fd5c42497f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.013282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.014322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.014615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.014897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] PATH_INFO: `/v3/projects/9af50753690d4501984c9ef83ee9205e/users/5b18be10af9d4fa9868434ebecaa0249/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.017757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af50753690d4501984c9ef83ee9205e, user_id=5b18be10af9d4fa9868434ebecaa0249, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.021712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.033094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0e5c6-978a-4a2c-97cf-e2c508b13a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.034444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e5c6-978a-4a2c-97cf-e2c508b13a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.034444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e5c6-978a-4a2c-97cf-e2c508b13a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.034869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e5c6-978a-4a2c-97cf-e2c508b13a12 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.035834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0e5c6-978a-4a2c-97cf-e2c508b13a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.038490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0e5c6-978a-4a2c-97cf-e2c508b13a12 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.044598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 920/1857] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:11 2022] PUT /identity/v3/projects/9af50753690d4501984c9ef83ee9205e/users/5b18be10af9d4fa9868434ebecaa0249/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:12.045602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:12.047364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:12.088387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 938/1858] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:11 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:12.091121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.091842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.092141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.138819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6337-46c8-44cc-93a8-b411eb74c7af admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.141392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] MFA Rules not processed for user `5b18be10af9d4fa9868434ebecaa0249`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:12.154285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:12.162640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.165223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.166015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.167288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.248533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:12.282990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.284555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.297366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 921/1859] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:12.298301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:12.315518 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 939/1860] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:12.331410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:12.333400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:12.354258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72168f-7ca8-48b7-aaa9-ef9424138ef1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.358672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.359422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.360416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.360416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.374691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.376728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.390378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 940/1861] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:12.452704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:12.463835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213fa69-0fcb-421d-82e3-083d89bad69e service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.478294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda7958-8170-494a-a82e-347b2e00fe01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.478964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda7958-8170-494a-a82e-347b2e00fe01 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.479231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda7958-8170-494a-a82e-347b2e00fe01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.479575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda7958-8170-494a-a82e-347b2e00fe01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.487920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b92791-04bd-4f71-959e-17cfab26bb7f service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.488817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2bda7958-8170-494a-a82e-347b2e00fe01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:12.501102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.501947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.502766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.504121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.505184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.515688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.538606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 922/1862] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:12.547498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:12.565994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201123-385c-4979-be29-7825788dfdbc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.581809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.582721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.583059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.583337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.584057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.585671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.590960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda7958-8170-494a-a82e-347b2e00fe01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.594570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda7958-8170-494a-a82e-347b2e00fe01 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.602919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 923/1863] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:12.603936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:12.615429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 941/1864] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:12.627170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404479e-5dac-44c6-915e-634da6aea56a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.640558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.641261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.641552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.641829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] PATH_INFO: `/v3/projects/2a1e6753298c44d2a2afc323ad202aba/users/f2813259ec8c4a34be411bd238a3cdb4/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.674091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1e6753298c44d2a2afc323ad202aba, user_id=f2813259ec8c4a34be411bd238a3cdb4, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.680230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:12.705488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 924/1865] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:12 2022] PUT /identity/v3/projects/2a1e6753298c44d2a2afc323ad202aba/users/f2813259ec8c4a34be411bd238a3cdb4/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:12.716193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275a90-b56e-43ee-8959-84fb2fb58a31 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.716756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275a90-b56e-43ee-8959-84fb2fb58a31 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.716756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275a90-b56e-43ee-8959-84fb2fb58a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.762763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2a275a90-b56e-43ee-8959-84fb2fb58a31 None None] MFA Rules not processed for user `f2813259ec8c4a34be411bd238a3cdb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:12.764171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2a275a90-b56e-43ee-8959-84fb2fb58a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:12.783637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:12.851834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 942/1866] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:12.859883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:12.960974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3c17-220a-4cd7-9dbb-cf764c334da8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:12.966442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:12.967132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:12.967590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:12.968055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:12.968904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:12.970990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.009736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 925/1867] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:12 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:13.014779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275a90-b56e-43ee-8959-84fb2fb58a31 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.033116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275a90-b56e-43ee-8959-84fb2fb58a31 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.113262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.114006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.115130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.115597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.116676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.119056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.150412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 943/1868] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:13 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:13.151783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.172387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503610d-ae72-4c05-8fdc-b711b985f094 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.179732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.180562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.181028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.181471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.182674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.185295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.200039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 926/1869] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:13.204679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.219705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525916e-a186-4be6-a92e-f3f139055953 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.237883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.244732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.245876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.246257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.246694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.247792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:13.248444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.251137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.267069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 944/1870] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:38:13.272166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.290882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cb60a-0a2e-4410-8f3e-d1706d128e7c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.300123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17168076-d93c-4f0d-b20d-b53d9ab73be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.301303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168076-d93c-4f0d-b20d-b53d9ab73be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.301687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168076-d93c-4f0d-b20d-b53d9ab73be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.302073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168076-d93c-4f0d-b20d-b53d9ab73be9 admin admin] PATH_INFO: `/v3/projects/7de02a3aaa8947e69f01b512b4b9223d/users/217b11c3bfb240b68170095dc6494e50/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.311441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaac6a6-e12f-4a6d-8e34-2ff4ef679375 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.317876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.318516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.318798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.319107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.320931 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:13.323454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17168076-d93c-4f0d-b20d-b53d9ab73be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de02a3aaa8947e69f01b512b4b9223d, user_id=217b11c3bfb240b68170095dc6494e50, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.328151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17168076-d93c-4f0d-b20d-b53d9ab73be9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.355082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 945/1871] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:13 2022] PUT /identity/v3/projects/7de02a3aaa8947e69f01b512b4b9223d/users/217b11c3bfb240b68170095dc6494e50/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:13.367518 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f4ce-e9ff-416f-9601-9ee69e6ce6ea None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.369158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f4ce-e9ff-416f-9601-9ee69e6ce6ea None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.369668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f4ce-e9ff-416f-9601-9ee69e6ce6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.405976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.407955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.413291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-4dd4f4ce-e9ff-416f-9601-9ee69e6ce6ea None None] MFA Rules not processed for user `217b11c3bfb240b68170095dc6494e50`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:13.414635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4dd4f4ce-e9ff-416f-9601-9ee69e6ce6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:13.421153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 927/1872] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:13.508597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:13.521719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 946/1873] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:13.526296 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.537921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46c7b-64f4-43d1-8151-93cb987d2d51 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.605430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.606529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.606816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.607129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.607797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.609840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.640371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 928/1874] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:13 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:13.644901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f4ce-e9ff-416f-9601-9ee69e6ce6ea None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.657544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f4ce-e9ff-416f-9601-9ee69e6ce6ea None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.744436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.745779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.746263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.747730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.748622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.750983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.780924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 947/1875] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:13 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:13.785171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.801836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec52b99-6d6c-4435-9f08-0b19b9310461 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.808316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.809687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.810646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.810948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.811673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.813413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.828866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 929/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:13.833149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.845863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aa538-e0e8-4371-afce-e0843bc85452 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:13.852795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:13.853498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:13.853858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:13.854188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] PATH_INFO: `/v3/projects/4c13974bb075434982ff57d15a22344a/users/aac025cd08224ea8820a8c3a1c271f38/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:13.903942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c13974bb075434982ff57d15a22344a, user_id=aac025cd08224ea8820a8c3a1c271f38, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:13.908023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:13.938011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 948/1877] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:13 2022] PUT /identity/v3/projects/4c13974bb075434982ff57d15a22344a/users/aac025cd08224ea8820a8c3a1c271f38/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:13.942054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:13.957965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795cfc3-a790-40f8-8321-d6f062a59ce4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:14.058336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:14.095230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34c3df-d7e4-406c-afb7-c1eb38e48533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:14.096324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34c3df-d7e4-406c-afb7-c1eb38e48533 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:14.096799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34c3df-d7e4-406c-afb7-c1eb38e48533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:14.097379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34c3df-d7e4-406c-afb7-c1eb38e48533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:14.098833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34c3df-d7e4-406c-afb7-c1eb38e48533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:14.101175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34c3df-d7e4-406c-afb7-c1eb38e48533 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:14.114217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 930/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:14.119291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:14.131945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f95f-2ac6-4323-9fd6-bf9c11c99645 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:14.146471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:14.147169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:14.147430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:14.147686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] PATH_INFO: `/v3/projects/4c13974bb075434982ff57d15a22344a/users/aac025cd08224ea8820a8c3a1c271f38/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:14.152251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c13974bb075434982ff57d15a22344a, user_id=aac025cd08224ea8820a8c3a1c271f38, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:14.155875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:14.167058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 949/1879] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:14 2022] PUT /identity/v3/projects/4c13974bb075434982ff57d15a22344a/users/aac025cd08224ea8820a8c3a1c271f38/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:14.178556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfa442-d46e-4322-93c0-ddd6edb8d0af None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:14.179088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfa442-d46e-4322-93c0-ddd6edb8d0af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:14.179354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfa442-d46e-4322-93c0-ddd6edb8d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:14.226143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-39cfa442-d46e-4322-93c0-ddd6edb8d0af None None] MFA Rules not processed for user `aac025cd08224ea8820a8c3a1c271f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:14.229750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-39cfa442-d46e-4322-93c0-ddd6edb8d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:14.330020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 931/1880] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:14.342877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:14.408411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b752892-6232-4c05-8200-9e9dc4978929 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:14.412059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11d152-ed7c-4fd0-a1a6-79175a1a3791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:14.412690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11d152-ed7c-4fd0-a1a6-79175a1a3791 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:14.412978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11d152-ed7c-4fd0-a1a6-79175a1a3791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:14.413256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11d152-ed7c-4fd0-a1a6-79175a1a3791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:14.478321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11d152-ed7c-4fd0-a1a6-79175a1a3791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:14.480473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11d152-ed7c-4fd0-a1a6-79175a1a3791 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:14.493230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 950/1881] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:15.704769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfa442-d46e-4322-93c0-ddd6edb8d0af None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:15.771491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfa442-d46e-4322-93c0-ddd6edb8d0af None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:15.776010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:15.776604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:15.776883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:15.777149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] PATH_INFO: `/v3/users/2b7286f017604c55901b5b32d5bad5c4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:15.778303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7286f017604c55901b5b32d5bad5c4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:15.780259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:15.827856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7286f017604c55901b5b32d5bad5c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:15.828508 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7286f017604c55901b5b32d5bad5c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:15.835839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7286f017604c55901b5b32d5bad5c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:15.841564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:15.844805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7286f017604c55901b5b32d5bad5c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:15.845623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7286f017604c55901b5b32d5bad5c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:15.865214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 932/1882] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:15 2022] DELETE /identity/v3/users/2b7286f017604c55901b5b32d5bad5c4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:15.869589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:15.870102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:15.870292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:15.879216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:15.891452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:15.892793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:15.976825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 951/1883] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:16.000986 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:16.002447 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:16.065906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197669a-2872-4107-ba18-5ed3d467a933 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:16.080238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:16.080937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:16.081592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:16.081592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:16.096194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:16.098248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:16.110767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 933/1884] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:16.224048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:16.225477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:16.307262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112f1c-99fd-4a8b-8a8c-0eee5cbab73c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:16.313318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:16.313954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:16.314236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:16.314560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:16.317273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:16.405296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:16.407789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:16.443795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 952/1885] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:16.889688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:16.891708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:16.912460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d6ac-3cd4-4397-9b3c-c60ff70b8a4b service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:16.930410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:16.931114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:16.931413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:16.931681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] PATH_INFO: `/v3/projects/5ae19ec999e44f5d9e8dc77bfc246d6e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:16.937327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae19ec999e44f5d9e8dc77bfc246d6e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:16.941026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:17.018483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae19ec999e44f5d9e8dc77bfc246d6e', 'request_id': 'req-ebbd8251-c37a-4b6b-800b-6031c88230c1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.028749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae19ec999e44f5d9e8dc77bfc246d6e', 'request_id': 'req-ebbd8251-c37a-4b6b-800b-6031c88230c1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.038000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae19ec999e44f5d9e8dc77bfc246d6e', 'request_id': 'req-ebbd8251-c37a-4b6b-800b-6031c88230c1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.057071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] The token cache is being invalidate because project 5ae19ec999e44f5d9e8dc77bfc246d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:17.057649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.058851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.061164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 934/1886] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:16 2022] DELETE /identity/v3/projects/5ae19ec999e44f5d9e8dc77bfc246d6e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:17.065516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:17.079945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648349-71a5-4d61-a299-12dfd220cead service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:17.271090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:17.272344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:17.272630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:17.273007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] PATH_INFO: `/v3/users/e4be0e903a404b2ebddf9a18f09362d3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:17.274654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4be0e903a404b2ebddf9a18f09362d3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:17.277400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:17.281489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:17.351368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4be0e903a404b2ebddf9a18f09362d3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.363269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4be0e903a404b2ebddf9a18f09362d3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.364141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4be0e903a404b2ebddf9a18f09362d3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.387602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4be0e903a404b2ebddf9a18f09362d3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.423389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4be0e903a404b2ebddf9a18f09362d3'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:17.442501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 953/1887] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:17 2022] DELETE /identity/v3/users/e4be0e903a404b2ebddf9a18f09362d3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:17.592001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:17.593756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:17.705383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd8251-c37a-4b6b-800b-6031c88230c1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:17.722523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:17.790182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:17.791319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:17.791607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:17.791878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:17.795109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:17.901705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:17.905483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:17.917044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 935/1888] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:18.271167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:18.275117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:18.275409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:18.278071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:18.302799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed573d-269f-4b9b-84a7-b24435de1c67 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:18.310243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f61491-209e-43f3-9021-68302fdc0b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:18.311560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61491-209e-43f3-9021-68302fdc0b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:18.312100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61491-209e-43f3-9021-68302fdc0b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:18.312533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61491-209e-43f3-9021-68302fdc0b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:18.315708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-62f61491-209e-43f3-9021-68302fdc0b6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:18.409238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f61491-209e-43f3-9021-68302fdc0b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:18.411264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f61491-209e-43f3-9021-68302fdc0b6e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:18.420333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a62c-3d0c-43b4-9347-71effeafd877 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:18.434916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 954/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:18.444080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:18.444572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:18.445256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:18.445535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] PATH_INFO: `/v3/projects/a753f4b60b7842288a87925c1cc1f574` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:18.447198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a753f4b60b7842288a87925c1cc1f574)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:18.449220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:18.561081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a753f4b60b7842288a87925c1cc1f574', 'request_id': 'req-6adf783f-b55b-479d-b13b-e3a72900476d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:18.577022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a753f4b60b7842288a87925c1cc1f574', 'request_id': 'req-6adf783f-b55b-479d-b13b-e3a72900476d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:18.592905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a753f4b60b7842288a87925c1cc1f574', 'request_id': 'req-6adf783f-b55b-479d-b13b-e3a72900476d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:18.607746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:18.618683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] The token cache is being invalidate because project a753f4b60b7842288a87925c1cc1f574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:18.618895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:18.619771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6adf783f-b55b-479d-b13b-e3a72900476d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:18.632238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 936/1890] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:18 2022] DELETE /identity/v3/projects/a753f4b60b7842288a87925c1cc1f574 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:18.632375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835f16-5138-4500-92ab-6a7601355a8b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:18.632375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835f16-5138-4500-92ab-6a7601355a8b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:18.632375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835f16-5138-4500-92ab-6a7601355a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:18.686469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c5835f16-5138-4500-92ab-6a7601355a8b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:18.687886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c5835f16-5138-4500-92ab-6a7601355a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:18.789319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 955/1891] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:18.799494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d0e0-f83f-4436-b3f9-997ca3f27e57 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:18.801044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d0e0-f83f-4436-b3f9-997ca3f27e57 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:18.801495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d0e0-f83f-4436-b3f9-997ca3f27e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:18.830854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7a45d0e0-f83f-4436-b3f9-997ca3f27e57 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:18.832142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7a45d0e0-f83f-4436-b3f9-997ca3f27e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:18.857170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835f16-5138-4500-92ab-6a7601355a8b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:18.862245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 937/1892] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:18.867608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835f16-5138-4500-92ab-6a7601355a8b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:18.873672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:18.874305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:18.874622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:18.875013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:18.875872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:18.876179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:18.878504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:18.898273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d0e0-f83f-4436-b3f9-997ca3f27e57 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:18.905436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 956/1893] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:18.926149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d0e0-f83f-4436-b3f9-997ca3f27e57 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:18.938513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:18.941181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:18.941181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:18.942462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:18.944153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:18.946305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.000768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 938/1894] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:18 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:19.004959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.017308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:19.024609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57e14-b515-4761-bde3-2feb7ed1ae12 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.108297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.109346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.109638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.109912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.110630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.112794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.145451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 957/1895] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:19 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:19.146692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.158247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c8784-e39a-4110-bbce-f1f69dccc95e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.163351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.164280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.164476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.164802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.165419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.169613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.187301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 939/1896] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:19.191554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.203249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa54f8-9028-49e5-89e2-80632da821d8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.208931 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2582f6-4964-4d74-bea0-6e67c5f6320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.209767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2582f6-4964-4d74-bea0-6e67c5f6320a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.210253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2582f6-4964-4d74-bea0-6e67c5f6320a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.210828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2582f6-4964-4d74-bea0-6e67c5f6320a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.211818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2582f6-4964-4d74-bea0-6e67c5f6320a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.213637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2582f6-4964-4d74-bea0-6e67c5f6320a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.228677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 958/1897] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:19.234020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.252012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a0ce-d7c9-488e-9ada-927d82ce8440 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.258825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.259595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.259844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.260217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] PATH_INFO: `/v3/projects/8932a4479d7e4f01b0b8001dd04b72b8/users/42e6996969e2431ab11bdb6afe499076/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.279190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8932a4479d7e4f01b0b8001dd04b72b8, user_id=42e6996969e2431ab11bdb6afe499076, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.282627 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.308208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 940/1898] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:19 2022] PUT /identity/v3/projects/8932a4479d7e4f01b0b8001dd04b72b8/users/42e6996969e2431ab11bdb6afe499076/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:19.322500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551b58a-c1d0-413f-9763-4a7c17e5de5a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.323000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551b58a-c1d0-413f-9763-4a7c17e5de5a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.323096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551b58a-c1d0-413f-9763-4a7c17e5de5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.378743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f551b58a-c1d0-413f-9763-4a7c17e5de5a None None] MFA Rules not processed for user `42e6996969e2431ab11bdb6afe499076`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:19.380124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f551b58a-c1d0-413f-9763-4a7c17e5de5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:19.513725 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 959/1899] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:19.519930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.628853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e104-90b3-42cf-93c8-9d5201b2685e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.634329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.635159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.635437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.635861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.636682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.639421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.677053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 941/1900] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:19 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:19.681154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551b58a-c1d0-413f-9763-4a7c17e5de5a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.693130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551b58a-c1d0-413f-9763-4a7c17e5de5a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.770131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.770765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.771118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.771392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.772217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.774624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.805383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 960/1901] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:19 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:19.806607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.817857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850efc-77cb-4774-a4c0-e3ec015cae30 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.822526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.823752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.823752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.823752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.824490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.826495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.838011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 942/1902] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:19.842493 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.847770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:19.853470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cc1d5-f8b9-4f27-8bba-0372b14dd5f7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.867004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.867676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.867958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.868235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] PATH_INFO: `/v3/projects/e73c29f0e27b4d56a3e13111938dd292/users/9d5e002341b34d15bfa7c2f3dc4345cb/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.898332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73c29f0e27b4d56a3e13111938dd292, user_id=9d5e002341b34d15bfa7c2f3dc4345cb, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.901053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:19.914423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 961/1903] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:19 2022] PUT /identity/v3/projects/e73c29f0e27b4d56a3e13111938dd292/users/9d5e002341b34d15bfa7c2f3dc4345cb/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:19.919337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:19.930297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b45a-5ab3-4723-9860-82bfed49d861 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:19.989525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4ea90-b8b3-467e-85d5-96eb895d0929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:19.990156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ea90-b8b3-467e-85d5-96eb895d0929 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:19.990439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ea90-b8b3-467e-85d5-96eb895d0929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:19.990904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ea90-b8b3-467e-85d5-96eb895d0929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:19.991639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4ea90-b8b3-467e-85d5-96eb895d0929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:19.993280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4ea90-b8b3-467e-85d5-96eb895d0929 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:20.003493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 943/1904] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:20.007764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:20.018901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d4f11-8149-4be8-8cd4-ad6004e2f501 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:20.023753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:20.024418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:20.024692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:20.024969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] PATH_INFO: `/v3/projects/e73c29f0e27b4d56a3e13111938dd292/users/9d5e002341b34d15bfa7c2f3dc4345cb/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:20.027043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73c29f0e27b4d56a3e13111938dd292, user_id=9d5e002341b34d15bfa7c2f3dc4345cb, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:20.030321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:20.046136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 962/1905] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:20 2022] PUT /identity/v3/projects/e73c29f0e27b4d56a3e13111938dd292/users/9d5e002341b34d15bfa7c2f3dc4345cb/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:20.056401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:20.056603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:20.056885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:20.065886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:20.091302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] MFA Rules not processed for user `9d5e002341b34d15bfa7c2f3dc4345cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:20.092528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:20.174091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 944/1906] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:20.185216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:20.187303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:20.253407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c32a2-ba66-4e76-aa05-89bad8d12f2b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:20.257303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c300184-d951-438f-bcdd-4551aaabd6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:20.258018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300184-d951-438f-bcdd-4551aaabd6ab service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:20.258302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300184-d951-438f-bcdd-4551aaabd6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:20.258592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300184-d951-438f-bcdd-4551aaabd6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:20.269771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c300184-d951-438f-bcdd-4551aaabd6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:20.271317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c300184-d951-438f-bcdd-4551aaabd6ab service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:20.288969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 963/1907] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:20 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:21.058407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:21.061407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:21.173235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bee92-25c0-4869-9f5d-e36ed0dcbc8a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:21.184744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:21.185857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:21.187512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:21.187898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] PATH_INFO: `/v3/users/744275e5171a42f79da0771ce00655a9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:21.190284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744275e5171a42f79da0771ce00655a9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:21.192531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:21.273095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744275e5171a42f79da0771ce00655a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:21.274242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744275e5171a42f79da0771ce00655a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:21.288035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744275e5171a42f79da0771ce00655a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:21.312792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744275e5171a42f79da0771ce00655a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:21.313516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744275e5171a42f79da0771ce00655a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:21.333531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 945/1908] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:21 2022] DELETE /identity/v3/users/744275e5171a42f79da0771ce00655a9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:21.339532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:21.340631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:21.340726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:21.368164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:21.370090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:21.498305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 964/1909] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:21.536459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:21.542385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:21.576308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:21.677284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ffc8f-6b44-40ba-83fb-c4d1b94b61f4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:21.685234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:21.685879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:21.686159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:21.686435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:21.698180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:21.700288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:21.710751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 946/1910] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:22.361347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:22.363949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:22.380774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1133f-0f6a-4486-bcec-24aa802918ba None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:22.389235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:22.390094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:22.391671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:22.399549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:22.400291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:22.400856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] PATH_INFO: `/v3/users/42e6996969e2431ab11bdb6afe499076` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:22.403443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e6996969e2431ab11bdb6afe499076)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:22.408137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:22.413536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a9bd5-c423-49e8-8d7d-967d9977acdd service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:22.429400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:22.430066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:22.430346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:22.430619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] PATH_INFO: `/v3/projects/b8c2f1534d89420c8c3ba021be030974` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:22.431902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c2f1534d89420c8c3ba021be030974)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:22.433919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:22.485003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e6996969e2431ab11bdb6afe499076'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.495388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e6996969e2431ab11bdb6afe499076'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.496342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e6996969e2431ab11bdb6afe499076'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.507336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e6996969e2431ab11bdb6afe499076'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.510882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:22.530096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c2f1534d89420c8c3ba021be030974', 'request_id': 'req-4abcefca-8cda-45ea-b7dc-98b6740b30f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.536108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e6996969e2431ab11bdb6afe499076'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.539904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c2f1534d89420c8c3ba021be030974', 'request_id': 'req-4abcefca-8cda-45ea-b7dc-98b6740b30f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.549937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 965/1911] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:22 2022] DELETE /identity/v3/users/42e6996969e2431ab11bdb6afe499076 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:22.550642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c2f1534d89420c8c3ba021be030974', 'request_id': 'req-4abcefca-8cda-45ea-b7dc-98b6740b30f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.551127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:22.552658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:22.569901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] The token cache is being invalidate because project b8c2f1534d89420c8c3ba021be030974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:22.571398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.572311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4abcefca-8cda-45ea-b7dc-98b6740b30f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.580235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 947/1912] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:22 2022] DELETE /identity/v3/projects/b8c2f1534d89420c8c3ba021be030974 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:22.583314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:22.583602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:22.583875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:22.620736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:22.623079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:22.644027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39031e9d-e879-4640-9add-0fda17d41599 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:22.657409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:22.658085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:22.658363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:22.658639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] PATH_INFO: `/v3/users/f2813259ec8c4a34be411bd238a3cdb4` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:22.661389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2813259ec8c4a34be411bd238a3cdb4)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:22.666173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:22.716908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 948/1913] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:22.718088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:22.720546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:22.738288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90044cb0-bd1b-4ab4-8c67-52da7e1093bf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:22.748391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:22.749146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:22.749492 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:22.749839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] PATH_INFO: `/v3/users/92578f078ed34f3da6ac2ff98448a705` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:22.751343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92578f078ed34f3da6ac2ff98448a705)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:22.753362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2813259ec8c4a34be411bd238a3cdb4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.754288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:22.763868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2813259ec8c4a34be411bd238a3cdb4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.764798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2813259ec8c4a34be411bd238a3cdb4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.777070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2813259ec8c4a34be411bd238a3cdb4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.799957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2813259ec8c4a34be411bd238a3cdb4'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.817549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:22.823234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 966/1914] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:22 2022] DELETE /identity/v3/users/f2813259ec8c4a34be411bd238a3cdb4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:22.823234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:22.825646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:22.835552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92578f078ed34f3da6ac2ff98448a705'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.836777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92578f078ed34f3da6ac2ff98448a705'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.848141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92578f078ed34f3da6ac2ff98448a705'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.858207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92578f078ed34f3da6ac2ff98448a705'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.859165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fff1abcf-74fc-4bb4-860c-437b11b919c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92578f078ed34f3da6ac2ff98448a705'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:22.893181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 949/1915] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:22 2022] DELETE /identity/v3/users/92578f078ed34f3da6ac2ff98448a705 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:22.896426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:22.896426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:22.896426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:22.912372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701260-034f-4c43-9d80-8948f6a13081 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:22.922017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:22.924939 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:22.929353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:23.023790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 950/1916] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:23.030058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:23.030705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:23.031011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:23.031286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:23.033268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:23.053060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:23.054794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:23.062692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:23.066219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:23.068056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 967/1917] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:23.083268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278588f-515a-49c0-b789-d8152c0a3378 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:23.087742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:23.088512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:23.088857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:23.089200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:23.109085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:23.111121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:23.127593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 951/1918] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:24.052492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:24.054593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:24.070544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a956d-c16c-40f8-82b5-30f484fb9410 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:24.092107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:24.093863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:24.098542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:24.099970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:24.103786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:24.104084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] PATH_INFO: `/v3/projects/8932a4479d7e4f01b0b8001dd04b72b8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:24.105821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8932a4479d7e4f01b0b8001dd04b72b8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:24.109033 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:24.145333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43468a7a-8c23-4fad-8e62-9d2fde3b056e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:24.162600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:24.163333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:24.163628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:24.163910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] PATH_INFO: `/v3/projects/f1f1291f2db94400a4ff9ddc7aaaa6de` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:24.169891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f1291f2db94400a4ff9ddc7aaaa6de)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:24.171815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:24.208947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8932a4479d7e4f01b0b8001dd04b72b8', 'request_id': 'req-510a320b-2842-4eb1-9e46-a6c47e00787f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.224292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8932a4479d7e4f01b0b8001dd04b72b8', 'request_id': 'req-510a320b-2842-4eb1-9e46-a6c47e00787f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.240384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8932a4479d7e4f01b0b8001dd04b72b8', 'request_id': 'req-510a320b-2842-4eb1-9e46-a6c47e00787f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.263636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] The token cache is being invalidate because project 8932a4479d7e4f01b0b8001dd04b72b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:24.264292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.265755 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.267733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 968/1919] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:24 2022] DELETE /identity/v3/projects/8932a4479d7e4f01b0b8001dd04b72b8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:24.269167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:24.271302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:24.282054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f1291f2db94400a4ff9ddc7aaaa6de', 'request_id': 'req-cfb07710-da32-406a-9ba7-b2f25085d755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.295678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f1291f2db94400a4ff9ddc7aaaa6de', 'request_id': 'req-cfb07710-da32-406a-9ba7-b2f25085d755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.304406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f1291f2db94400a4ff9ddc7aaaa6de', 'request_id': 'req-cfb07710-da32-406a-9ba7-b2f25085d755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.331763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] The token cache is being invalidate because project f1f1291f2db94400a4ff9ddc7aaaa6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:24.332305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.333135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.336125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 952/1920] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:24 2022] DELETE /identity/v3/projects/f1f1291f2db94400a4ff9ddc7aaaa6de => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:24.336946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:24.339382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:24.359591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a320b-2842-4eb1-9e46-a6c47e00787f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:24.365151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:24.417366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:24.438108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07710-da32-406a-9ba7-b2f25085d755 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:24.455300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:24.456064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:24.456430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:24.456636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:24.456763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] PATH_INFO: `/v3/projects/2a1e6753298c44d2a2afc323ad202aba` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:24.457828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:24.458120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1e6753298c44d2a2afc323ad202aba)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:24.459653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:24.459653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] PATH_INFO: `/v3/users/9d5e002341b34d15bfa7c2f3dc4345cb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:24.460384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:24.463825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5e002341b34d15bfa7c2f3dc4345cb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:24.469451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:24.521377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1e6753298c44d2a2afc323ad202aba', 'request_id': 'req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.528709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1e6753298c44d2a2afc323ad202aba', 'request_id': 'req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.540855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1e6753298c44d2a2afc323ad202aba', 'request_id': 'req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.541622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5e002341b34d15bfa7c2f3dc4345cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.542315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5e002341b34d15bfa7c2f3dc4345cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.557409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5e002341b34d15bfa7c2f3dc4345cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.561386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] The token cache is being invalidate because project 2a1e6753298c44d2a2afc323ad202aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:24.561578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.563619 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.568735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 969/1921] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:24 2022] DELETE /identity/v3/projects/2a1e6753298c44d2a2afc323ad202aba => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:24.569394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:24.572650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:24.573474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5e002341b34d15bfa7c2f3dc4345cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.576896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5e002341b34d15bfa7c2f3dc4345cb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.599047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 953/1922] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:24 2022] DELETE /identity/v3/users/9d5e002341b34d15bfa7c2f3dc4345cb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:24.603136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:24.604610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:24.679478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae10e-a328-4b9f-8bbe-3fc55da0b46b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:24.686795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:24.687588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:24.688572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:24.689473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] PATH_INFO: `/v3/users/5b18be10af9d4fa9868434ebecaa0249` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:24.691669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b18be10af9d4fa9868434ebecaa0249)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:24.694014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354972a-11b4-4ee8-8331-035ed848d1cd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:24.697842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:24.701823 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:24.702758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:24.703284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:24.703782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] PATH_INFO: `/v3/users/217b11c3bfb240b68170095dc6494e50` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:24.705510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217b11c3bfb240b68170095dc6494e50)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:24.707419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:24.769889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b18be10af9d4fa9868434ebecaa0249'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.778069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b18be10af9d4fa9868434ebecaa0249'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.778992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b18be10af9d4fa9868434ebecaa0249'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.786983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:24.789175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b18be10af9d4fa9868434ebecaa0249'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.798476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217b11c3bfb240b68170095dc6494e50'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.799563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217b11c3bfb240b68170095dc6494e50'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.807615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b18be10af9d4fa9868434ebecaa0249'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.811579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:24.813998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217b11c3bfb240b68170095dc6494e50'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.816487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 970/1923] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:24 2022] DELETE /identity/v3/users/5b18be10af9d4fa9868434ebecaa0249 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:24.826159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217b11c3bfb240b68170095dc6494e50'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.827182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217b11c3bfb240b68170095dc6494e50'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:24.854023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 954/1924] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:24 2022] DELETE /identity/v3/users/217b11c3bfb240b68170095dc6494e50 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:25.111497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:25.113809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:25.256913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05377d8f-ee23-4e01-9c05-8926a75cb2e1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:25.361329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:25.362019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.362344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.362722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] PATH_INFO: `/v3/projects/e73c29f0e27b4d56a3e13111938dd292` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:25.372480 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73c29f0e27b4d56a3e13111938dd292)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:25.374649 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:25.472038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:25.474322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:25.494923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dac27-29b9-416d-b208-b45e226ae7c7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:25.497387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73c29f0e27b4d56a3e13111938dd292', 'request_id': 'req-4ee42b28-77cf-45dc-9330-a9106ab642b5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.508273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73c29f0e27b4d56a3e13111938dd292', 'request_id': 'req-4ee42b28-77cf-45dc-9330-a9106ab642b5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.522160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73c29f0e27b4d56a3e13111938dd292', 'request_id': 'req-4ee42b28-77cf-45dc-9330-a9106ab642b5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.545595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] The token cache is being invalidate because project e73c29f0e27b4d56a3e13111938dd292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:25.545859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.550593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.552948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 971/1925] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:25 2022] DELETE /identity/v3/projects/e73c29f0e27b4d56a3e13111938dd292 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:25.554345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:25.556261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:25.622493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:25.623597 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.624069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.624542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] PATH_INFO: `/v3/projects/9af50753690d4501984c9ef83ee9205e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:25.626451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af50753690d4501984c9ef83ee9205e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:25.629244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:25.643758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:25.695676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42b28-77cf-45dc-9330-a9106ab642b5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:25.707675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af50753690d4501984c9ef83ee9205e', 'request_id': 'req-ac060183-d715-4734-b4d2-3fc11ce98b0a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.716985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af50753690d4501984c9ef83ee9205e', 'request_id': 'req-ac060183-d715-4734-b4d2-3fc11ce98b0a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.725257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af50753690d4501984c9ef83ee9205e', 'request_id': 'req-ac060183-d715-4734-b4d2-3fc11ce98b0a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.743409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] The token cache is being invalidate because project 9af50753690d4501984c9ef83ee9205e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:25.744048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.744834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ac060183-d715-4734-b4d2-3fc11ce98b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.747399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 955/1926] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:25 2022] DELETE /identity/v3/projects/9af50753690d4501984c9ef83ee9205e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:25.748433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38067-6efc-4c5f-9549-6bd226a47041 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.748718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38067-6efc-4c5f-9549-6bd226a47041 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.749118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38067-6efc-4c5f-9549-6bd226a47041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:25.770524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ecf38067-6efc-4c5f-9549-6bd226a47041 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:25.771784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ecf38067-6efc-4c5f-9549-6bd226a47041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:25.780477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:25.781048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.781331 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.781610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] PATH_INFO: `/v3/projects/7de02a3aaa8947e69f01b512b4b9223d` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:25.782827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de02a3aaa8947e69f01b512b4b9223d)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:25.784810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:25.821992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:25.842522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de02a3aaa8947e69f01b512b4b9223d', 'request_id': 'req-2ef3edc9-4d72-4e48-97bd-a314884d4a97'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.845269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 956/1927] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:25.846633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.846923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.847375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:25.849067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de02a3aaa8947e69f01b512b4b9223d', 'request_id': 'req-2ef3edc9-4d72-4e48-97bd-a314884d4a97'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.859720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de02a3aaa8947e69f01b512b4b9223d', 'request_id': 'req-2ef3edc9-4d72-4e48-97bd-a314884d4a97'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.868316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:25.869649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:25.873460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] The token cache is being invalidate because project 7de02a3aaa8947e69f01b512b4b9223d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:25.873763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.874486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2ef3edc9-4d72-4e48-97bd-a314884d4a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:25.876334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 972/1928] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:25 2022] DELETE /identity/v3/projects/7de02a3aaa8947e69f01b512b4b9223d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:25.877651 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1adf-acb7-445e-af0a-9b417c501a25 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.877916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1adf-acb7-445e-af0a-9b417c501a25 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.878226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1adf-acb7-445e-af0a-9b417c501a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:25.899047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0aff1adf-acb7-445e-af0a-9b417c501a25 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:25.900269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0aff1adf-acb7-445e-af0a-9b417c501a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:25.933125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 957/1929] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:25.934613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:25.943081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:25.956714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb360ba8-9986-4f34-bf47-d84987361803 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:25.962217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:25.962918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.963221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.963499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] PATH_INFO: `/v3/users/aac025cd08224ea8820a8c3a1c271f38` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:25.964662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac025cd08224ea8820a8c3a1c271f38)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:25.966972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:25.985565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 973/1930] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:25.987872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856181ff-a957-42f3-b90b-097dd5760cf0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:25.987872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856181ff-a957-42f3-b90b-097dd5760cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:25.987872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856181ff-a957-42f3-b90b-097dd5760cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.024379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-856181ff-a957-42f3-b90b-097dd5760cf0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:26.025734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-856181ff-a957-42f3-b90b-097dd5760cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.029055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac025cd08224ea8820a8c3a1c271f38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.029729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac025cd08224ea8820a8c3a1c271f38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.037451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 974/1931] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:26.038279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856181ff-a957-42f3-b90b-097dd5760cf0 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.040908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac025cd08224ea8820a8c3a1c271f38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.048278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac025cd08224ea8820a8c3a1c271f38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.049052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac025cd08224ea8820a8c3a1c271f38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.049302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856181ff-a957-42f3-b90b-097dd5760cf0 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.054640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.055291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.055566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.055833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.056524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:26.056823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.058561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.060514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:26.068080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 958/1932] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:25 2022] DELETE /identity/v3/users/aac025cd08224ea8820a8c3a1c271f38 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:26.068912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.070455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.081008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 975/1933] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:26.085467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.088085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.106771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06ea0a-bb8b-4973-adb8-8ca2afaee475 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.164101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbef4-d766-4424-abfa-20a4a18d9e97 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.178423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.179549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.180335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.181101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.183228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:26.184208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.186891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.188502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.189010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.189010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.189241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.190093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.192424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.193206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:26.219869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 959/1934] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:26.221543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.242441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2732a-530a-47e5-84e3-af7a1d46790c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.252935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.253714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.254202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.254581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.255521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.256218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 976/1935] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:26.259476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.263800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.299213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 960/1936] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:26.301067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.379950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669355-28af-4bc1-8d83-88d5e275b6e1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.411100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415ff3e-d90c-48fe-9af4-00d2f373c05a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.417235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.418285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.420840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.420840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.423463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.426435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.463369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 961/1937] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:26.465414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.483153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02beb-7558-434f-b393-e2dad0b487ef admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.489288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.491253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.491536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.491813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.492908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.495435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.515838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 962/1938] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:26.520437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.524853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.525501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.525784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.526060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.528004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.530004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.546624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12fba-2584-4ac4-b9f2-44f669e288d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.552444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.553202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.553417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.553703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.554557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.556428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.574168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 977/1939] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:26.576394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 963/1940] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:26.580455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.581431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.592422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47555145-e7bc-4fe6-bb58-848cb5bd83af admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.600702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.601831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.601831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.602026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] PATH_INFO: `/v3/projects/9437096768884037a82e905acd378145/users/fafd8db86971461ba705384692e0b709/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.602133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fee1f-fc7c-4f54-81c2-9e2e69a5a3f9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.610225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.610694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.611388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.611617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.612332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.614227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.622072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9437096768884037a82e905acd378145, user_id=fafd8db86971461ba705384692e0b709, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.625543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.639138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 978/1941] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:26.639138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.640104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.643002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 964/1942] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:26 2022] PUT /identity/v3/projects/9437096768884037a82e905acd378145/users/fafd8db86971461ba705384692e0b709/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:26.644047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.649816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:26.654854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea92130-5c1f-4789-a8ff-8c31f0e4d98e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.719583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.721205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.721756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.722252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] PATH_INFO: `/v3/projects/4c13974bb075434982ff57d15a22344a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.722808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffdd88-458f-46d5-a9a8-9cf76eec7f63 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.723940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c13974bb075434982ff57d15a22344a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.726218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.727771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be11b9-d52d-4e6c-bf44-94b98574d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.728558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be11b9-d52d-4e6c-bf44-94b98574d4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.728847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be11b9-d52d-4e6c-bf44-94b98574d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.729123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be11b9-d52d-4e6c-bf44-94b98574d4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.730177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be11b9-d52d-4e6c-bf44-94b98574d4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.732471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be11b9-d52d-4e6c-bf44-94b98574d4e7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.745046 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 965/1943] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:26.746546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be81848-ccbe-4a7b-9568-f838a671a4bc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.746840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be81848-ccbe-4a7b-9568-f838a671a4bc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.747139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be81848-ccbe-4a7b-9568-f838a671a4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.771398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:26.781565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8be81848-ccbe-4a7b-9568-f838a671a4bc None None] MFA Rules not processed for user `fafd8db86971461ba705384692e0b709`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:26.783297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8be81848-ccbe-4a7b-9568-f838a671a4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.788911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c13974bb075434982ff57d15a22344a', 'request_id': 'req-477c68b6-b5f4-424d-b5c0-7699040343ea'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.795479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c13974bb075434982ff57d15a22344a', 'request_id': 'req-477c68b6-b5f4-424d-b5c0-7699040343ea'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.805145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c13974bb075434982ff57d15a22344a', 'request_id': 'req-477c68b6-b5f4-424d-b5c0-7699040343ea'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.824693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] The token cache is being invalidate because project 4c13974bb075434982ff57d15a22344a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:26.824993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.825646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:26.827384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 979/1944] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:26 2022] DELETE /identity/v3/projects/4c13974bb075434982ff57d15a22344a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:26.830789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.831703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.866278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 966/1945] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:26.867989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db513-ae2e-4ca9-bbc9-8c06d7abe7ca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.868278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db513-ae2e-4ca9-bbc9-8c06d7abe7ca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.868555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db513-ae2e-4ca9-bbc9-8c06d7abe7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.888690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ed4db513-ae2e-4ca9-bbc9-8c06d7abe7ca None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:26.889922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed4db513-ae2e-4ca9-bbc9-8c06d7abe7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.908116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c68b6-b5f4-424d-b5c0-7699040343ea admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:26.914433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:26.915257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.915574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.916039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] PATH_INFO: `/v3/projects/cd7021c07ca84d0d8436baf95f7d4e56/users/3f4ea05be08b436199f544f8822d38ed/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.933012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7021c07ca84d0d8436baf95f7d4e56, user_id=3f4ea05be08b436199f544f8822d38ed, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:26.936436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:26.960800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 980/1946] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:26 2022] PUT /identity/v3/projects/cd7021c07ca84d0d8436baf95f7d4e56/users/3f4ea05be08b436199f544f8822d38ed/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:26.961742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:26.963512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:26.971323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 967/1947] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:26.973230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2303c-2027-4958-a5ac-5dedd3208588 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:26.973696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2303c-2027-4958-a5ac-5dedd3208588 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:26.973978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2303c-2027-4958-a5ac-5dedd3208588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:26.996462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:27.005904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2aa2303c-2027-4958-a5ac-5dedd3208588 None None] MFA Rules not processed for user `3f4ea05be08b436199f544f8822d38ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:27.007815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2aa2303c-2027-4958-a5ac-5dedd3208588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:27.066229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabcab7-b0db-4ad5-9351-81d95ade1b88 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.072068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.072869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.073149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.073424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.075154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.077405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.105539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 968/1948] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:27.107261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d51c-b071-4439-bb82-8562376d25e7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.107575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d51c-b071-4439-bb82-8562376d25e7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.108449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d51c-b071-4439-bb82-8562376d25e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.123882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 981/1949] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:26 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:27.126067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.137983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ebc5d51c-b071-4439-bb82-8562376d25e7 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:27.140456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ebc5d51c-b071-4439-bb82-8562376d25e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:27.170892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:27.207453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb0ccd-9d92-4f33-b213-53348be28ee2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.209660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 969/1950] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:27.210616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d51c-b071-4439-bb82-8562376d25e7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.213890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.215665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.216147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.216595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.217788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.220508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.223735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d51c-b071-4439-bb82-8562376d25e7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.229602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.231857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.232129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.232407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.233070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.235902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.253560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 982/1951] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:27.254599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.264577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 970/1952] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:27.265448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.275943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6489a7-6e2e-4fb0-b31b-6688fd4e4b31 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.329521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333b34d-f271-4bd9-a826-dc8270f786b6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.334741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.335413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.335689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.335959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.336660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:27.336962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.338584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.338842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.339514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.340888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.340888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.341521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.343566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.352383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 983/1953] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:27.353271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.368443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6c6c4-f7c3-4d81-9843-2751af6a3492 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.373466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.374090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 971/1954] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:27.374874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.377105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.377395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.377671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.378386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.380115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.388266 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d24e48-1975-49af-815f-fb9723f0f7c7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.392085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 984/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:27.394126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.395548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.395850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.396131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.396526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.396829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.398783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.408166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef362e-6d1b-4db5-8142-8526bed472f9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.413425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.414417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.414760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.415139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.416085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.418080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.425064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:27.436085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 972/1956] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:27.436085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.441525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 985/1957] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:27.446914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.459186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0eaaa-785a-4de8-8915-d7f075576f08 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.523279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fd708-1c08-49a0-9491-d3a3e7850d4a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.528500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.529389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.529759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.530105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.530523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.530843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.530972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.531241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.532003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.532269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.533788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.534657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.562665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 973/1958] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:27.563451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.568943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 986/1959] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:27.568943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.576651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e48c9-7607-40f6-a097-9345e88863f2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.581470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.582203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.582505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.582760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] PATH_INFO: `/v3/projects/cae93d6573734d7aa1c1dc42c2cdd45e/users/5e3f2fe8537a4b0591a194d8793ea61b/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.589876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687697f-3397-433c-977c-4e0238fe6a9f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.594843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.595559 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.595837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.596111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] PATH_INFO: `/v3/projects/dafff5b127b94c92a07d057af6c5aba5/users/720a5ea9aa2e49afbf908cc9f2648dd0/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.600131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae93d6573734d7aa1c1dc42c2cdd45e, user_id=5e3f2fe8537a4b0591a194d8793ea61b, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.602906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.607078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:27.615126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafff5b127b94c92a07d057af6c5aba5, user_id=720a5ea9aa2e49afbf908cc9f2648dd0, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.618259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.623374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 974/1960] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:27 2022] PUT /identity/v3/projects/cae93d6573734d7aa1c1dc42c2cdd45e/users/5e3f2fe8537a4b0591a194d8793ea61b/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:27.624430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.638230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 987/1961] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:27 2022] PUT /identity/v3/projects/dafff5b127b94c92a07d057af6c5aba5/users/720a5ea9aa2e49afbf908cc9f2648dd0/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:27.639237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.703244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542c974-8a73-4ad0-9198-82847020419b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.728732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711541-c2f7-4720-b9db-ba1712c45f3e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.741014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dae31f-c629-4cca-96dc-86c4d3c398f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.741014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae31f-c629-4cca-96dc-86c4d3c398f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.741294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae31f-c629-4cca-96dc-86c4d3c398f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.741388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae31f-c629-4cca-96dc-86c4d3c398f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.742048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dae31f-c629-4cca-96dc-86c4d3c398f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.743738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dae31f-c629-4cca-96dc-86c4d3c398f4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.755811 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 988/1962] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:27.757303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a1e7-8598-499a-9c57-aabd7358d56a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.757600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a1e7-8598-499a-9c57-aabd7358d56a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.757880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a1e7-8598-499a-9c57-aabd7358d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.773549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.774387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.774660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.774852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.775592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.778113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.790093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 975/1963] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:27.791063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.804472 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0da2a1e7-8598-499a-9c57-aabd7358d56a None None] MFA Rules not processed for user `720a5ea9aa2e49afbf908cc9f2648dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:27.805671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0da2a1e7-8598-499a-9c57-aabd7358d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:27.821572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a260c-3fb2-4137-8d02-5bfb3ca5cafa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.836345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.837057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.837339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.837622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] PATH_INFO: `/v3/projects/cae93d6573734d7aa1c1dc42c2cdd45e/users/5e3f2fe8537a4b0591a194d8793ea61b/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.843703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae93d6573734d7aa1c1dc42c2cdd45e, user_id=5e3f2fe8537a4b0591a194d8793ea61b, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.846405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.860727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 976/1964] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:27 2022] PUT /identity/v3/projects/cae93d6573734d7aa1c1dc42c2cdd45e/users/5e3f2fe8537a4b0591a194d8793ea61b/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:27.863242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.877596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:27.908836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 989/1965] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:27.911047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a7fb-31f8-4858-86f8-e3ca2e6ab6da None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.912389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a7fb-31f8-4858-86f8-e3ca2e6ab6da None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.912842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a7fb-31f8-4858-86f8-e3ca2e6ab6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.950599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04dc3-4377-479c-b3f6-7304c84f7995 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.956154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6f26a7fb-31f8-4858-86f8-e3ca2e6ab6da None None] MFA Rules not processed for user `5e3f2fe8537a4b0591a194d8793ea61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:27.956430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.958337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6f26a7fb-31f8-4858-86f8-e3ca2e6ab6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:27.958464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.958464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.958464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:27.958740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:27.960716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:27.974575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 977/1966] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:27.975970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:27.989519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4b3f-57d4-4596-939e-35aa35c074c1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:27.997654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:27.999227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:27.999577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:27.999920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.000799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.002811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.030222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:28.043632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 978/1967] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:28.047712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.052603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 990/1968] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:28.052778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a7fb-31f8-4858-86f8-e3ca2e6ab6da None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.074050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a7fb-31f8-4858-86f8-e3ca2e6ab6da None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.125836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a90dbb-3e87-421e-881d-6f028babbd4b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.131692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.132672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.133022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.133379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] PATH_INFO: `/v3/projects/1cb0c75f07074dfdb118d5120ffc128c/users/3e1c8b1e8375478888a9a7358bad9bae/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.153362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb0c75f07074dfdb118d5120ffc128c, user_id=3e1c8b1e8375478888a9a7358bad9bae, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.153932 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512330-45fa-4e28-96e0-2145eec35892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.154581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512330-45fa-4e28-96e0-2145eec35892 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.154860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512330-45fa-4e28-96e0-2145eec35892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.155169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512330-45fa-4e28-96e0-2145eec35892 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.155896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e512330-45fa-4e28-96e0-2145eec35892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.157202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.157864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e512330-45fa-4e28-96e0-2145eec35892 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.175978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 979/1969] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:28 2022] PUT /identity/v3/projects/1cb0c75f07074dfdb118d5120ffc128c/users/3e1c8b1e8375478888a9a7358bad9bae/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:28.176891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.178662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:28.189813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 991/1970] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:28 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:28.191521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069526b5-267b-4d85-b490-0d7282f750d6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.191813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069526b5-267b-4d85-b490-0d7282f750d6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.192086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069526b5-267b-4d85-b490-0d7282f750d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.217776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-069526b5-267b-4d85-b490-0d7282f750d6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:28.219191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-069526b5-267b-4d85-b490-0d7282f750d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:28.260241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7e41-18c4-4555-8ff7-5b17a2a73a3d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.266135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.266849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.267185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.267568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.292680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 992/1971] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:28.298002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069526b5-267b-4d85-b490-0d7282f750d6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.309115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069526b5-267b-4d85-b490-0d7282f750d6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.314544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.315216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.315499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.315774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.316536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.318593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.320247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:28.333547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 993/1972] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:28.334513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.338452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:28.350426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.352182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.363676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 980/1973] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:28.364408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.375326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c90b-d1e3-4633-90df-bb671e9c0040 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.381397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.382523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.383071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.383506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] PATH_INFO: `/v3/projects/6be9f03f252a4c448fed164c7a7707b3/users/78dc692769404dc78c07bc47939bc8c9/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.430307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be9f03f252a4c448fed164c7a7707b3, user_id=78dc692769404dc78c07bc47939bc8c9, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.433060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.436785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec9ea3-8c14-44d8-b2a4-26e536555e20 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.451423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.452091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.452372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.452826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.469335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 981/1974] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:28 2022] PUT /identity/v3/projects/6be9f03f252a4c448fed164c7a7707b3/users/78dc692769404dc78c07bc47939bc8c9/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:28.470218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.477763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.479779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.480716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:28.492418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 994/1975] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:28.493454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.504544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba84ca-334f-4d4f-87e0-3ade25a06a0a service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.553860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac68a9-1f03-43da-87f2-5ea783bfae8b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.561044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.561815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.561968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.562279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] PATH_INFO: `/v3/users/3f4ea05be08b436199f544f8822d38ed` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.563648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4ea05be08b436199f544f8822d38ed)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.566006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.581433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.581784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.582044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.582319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.583046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.585142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.596073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 995/1976] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:28.600257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.614171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee01a5-296b-4912-a6c6-64d02cdfa273 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:28.620018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99983c-55ba-45d9-a8f9-7e1cacb674e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:28.621409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99983c-55ba-45d9-a8f9-7e1cacb674e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.621650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99983c-55ba-45d9-a8f9-7e1cacb674e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.621996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99983c-55ba-45d9-a8f9-7e1cacb674e7 admin admin] PATH_INFO: `/v3/projects/6be9f03f252a4c448fed164c7a7707b3/users/78dc692769404dc78c07bc47939bc8c9/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.624191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99983c-55ba-45d9-a8f9-7e1cacb674e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be9f03f252a4c448fed164c7a7707b3, user_id=78dc692769404dc78c07bc47939bc8c9, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:28.627770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99983c-55ba-45d9-a8f9-7e1cacb674e7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:28.631811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4ea05be08b436199f544f8822d38ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:28.633178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4ea05be08b436199f544f8822d38ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:28.641688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 996/1977] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:28 2022] PUT /identity/v3/projects/6be9f03f252a4c448fed164c7a7707b3/users/78dc692769404dc78c07bc47939bc8c9/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:28.653829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.654165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.654294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4ea05be08b436199f544f8822d38ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:28.654455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.662810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4ea05be08b436199f544f8822d38ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:28.663808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c683587-2f6d-473e-b25b-080be8ec665b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4ea05be08b436199f544f8822d38ed'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:28.693432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 982/1978] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:28 2022] DELETE /identity/v3/users/3f4ea05be08b436199f544f8822d38ed => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:28.698847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] MFA Rules not processed for user `78dc692769404dc78c07bc47939bc8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:28.699478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:28.699892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:28.700198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:28.700432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:28.724154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:28.725174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:28.851165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 997/1979] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:28.866298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.872385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 983/1980] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:28.872553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:28.880556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:28.912960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:28.914537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:28.986209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:28.998089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a980b61-f218-4aad-b09b-20fddc1bb45f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:29.009267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:29.010059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:29.010347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:29.010618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:29.032753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:29.035879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:29.049322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5d85d-aaa8-4c64-b3cc-b73a1038f5d7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:29.051827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 998/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:29.068030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d440108-0983-4a29-84ca-731d6e52a226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:29.069186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440108-0983-4a29-84ca-731d6e52a226 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:29.069678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440108-0983-4a29-84ca-731d6e52a226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:29.070154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440108-0983-4a29-84ca-731d6e52a226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:29.089093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d440108-0983-4a29-84ca-731d6e52a226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:29.092108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d440108-0983-4a29-84ca-731d6e52a226 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:29.112520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 984/1982] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:29.112961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:29.114378 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:29.130170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4da95-af6e-407e-a21b-485bea7901f4 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:29.146473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:29.147150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:29.147426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:29.147694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:29.150076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:29.247981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:29.250284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:29.261164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 999/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:29.681705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81586b8-8840-4ab7-948c-1a1b60e83136 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:29.693016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81586b8-8840-4ab7-948c-1a1b60e83136 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:29.693380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81586b8-8840-4ab7-948c-1a1b60e83136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:29.710090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:29.711644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:29.748885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce57be-1810-4fab-b207-54254679829c service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:29.758353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:29.762150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:29.771410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:29.771700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] PATH_INFO: `/v3/projects/cd7021c07ca84d0d8436baf95f7d4e56` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:29.787604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7021c07ca84d0d8436baf95f7d4e56)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:29.791297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:29.791463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e81586b8-8840-4ab7-948c-1a1b60e83136 None None] MFA Rules not processed for user `3e1c8b1e8375478888a9a7358bad9bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:29.793379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e81586b8-8840-4ab7-948c-1a1b60e83136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:29.914885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7021c07ca84d0d8436baf95f7d4e56', 'request_id': 'req-05726f59-c206-4f11-a285-cba200af6493'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:29.925081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7021c07ca84d0d8436baf95f7d4e56', 'request_id': 'req-05726f59-c206-4f11-a285-cba200af6493'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:29.945516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7021c07ca84d0d8436baf95f7d4e56', 'request_id': 'req-05726f59-c206-4f11-a285-cba200af6493'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:29.971382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] The token cache is being invalidate because project cd7021c07ca84d0d8436baf95f7d4e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:29.971857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:29.972717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:29.973076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 985/1984] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:29.990901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81586b8-8840-4ab7-948c-1a1b60e83136 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:29.991521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1000/1985] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:29 2022] DELETE /identity/v3/projects/cd7021c07ca84d0d8436baf95f7d4e56 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:29.996499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:30.000052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:30.018624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81586b8-8840-4ab7-948c-1a1b60e83136 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:30.102610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:30.108311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d04422-8254-434d-8a11-aa348da78a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:30.112202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04422-8254-434d-8a11-aa348da78a62 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.112202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04422-8254-434d-8a11-aa348da78a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.112454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04422-8254-434d-8a11-aa348da78a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.116926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1d04422-8254-434d-8a11-aa348da78a62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:30.157178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05726f59-c206-4f11-a285-cba200af6493 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:30.162196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:30.163201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.163313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.163669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] PATH_INFO: `/v3/users/5e3f2fe8537a4b0591a194d8793ea61b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.165057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3f2fe8537a4b0591a194d8793ea61b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:30.167915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:30.214226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d04422-8254-434d-8a11-aa348da78a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:30.216391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d04422-8254-434d-8a11-aa348da78a62 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:30.233760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3f2fe8537a4b0591a194d8793ea61b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.239530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 986/1986] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:30.255422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3f2fe8537a4b0591a194d8793ea61b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.256301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3f2fe8537a4b0591a194d8793ea61b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.265903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3f2fe8537a4b0591a194d8793ea61b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.281913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-75945157-6957-4332-928c-183898f6b2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3f2fe8537a4b0591a194d8793ea61b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.290734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1001/1987] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:29 2022] DELETE /identity/v3/users/5e3f2fe8537a4b0591a194d8793ea61b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:30.418479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbc92-137d-4c61-865b-a4e4c7fe6855 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.418862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbc92-137d-4c61-865b-a4e4c7fe6855 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.419175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbc92-137d-4c61-865b-a4e4c7fe6855 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.421321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 987/1988] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:38:30.466470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.467379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.470446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.507877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:30.509207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:30.538352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffbc92-137d-4c61-865b-a4e4c7fe6855 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:30.546907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a0ffbc92-137d-4c61-865b-a4e4c7fe6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:30.585418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:30.638517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1002/1989] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:38:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:30.645674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:30.650360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:30.674444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab734576-edc6-4c92-9290-b92e938455ad None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:30.680936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:30.682246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.682671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.683170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.696240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffbc92-137d-4c61-865b-a4e4c7fe6855 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:30.701208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:30.702766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:30.703311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:30.703470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.703755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.704031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] PATH_INFO: `/v3/users/8626f3989b81473ba4e72f9602a46a75` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.705370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8626f3989b81473ba4e72f9602a46a75)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:30.708107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:30.731190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1003/1990] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:30.732187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:30.734622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:30.752764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755929-d049-4c45-b4ed-371464c0e0f9 service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:30.759829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:30.760673 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.760959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.761233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] PATH_INFO: `/v3/projects/cae93d6573734d7aa1c1dc42c2cdd45e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.763025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae93d6573734d7aa1c1dc42c2cdd45e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:30.765068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:30.776701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8626f3989b81473ba4e72f9602a46a75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.777410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8626f3989b81473ba4e72f9602a46a75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.785089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8626f3989b81473ba4e72f9602a46a75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.793804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8626f3989b81473ba4e72f9602a46a75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.794619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e60d415c-8018-4fb6-8d3f-41753aca029f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8626f3989b81473ba4e72f9602a46a75'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.798558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:30.816405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 988/1991] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:30 2022] DELETE /identity/v3/users/8626f3989b81473ba4e72f9602a46a75 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:30.819523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae93d6573734d7aa1c1dc42c2cdd45e', 'request_id': 'req-270edc93-8151-4857-b70f-ff11867199fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.823525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae93d6573734d7aa1c1dc42c2cdd45e', 'request_id': 'req-270edc93-8151-4857-b70f-ff11867199fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.831916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae93d6573734d7aa1c1dc42c2cdd45e', 'request_id': 'req-270edc93-8151-4857-b70f-ff11867199fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.844303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] The token cache is being invalidate because project cae93d6573734d7aa1c1dc42c2cdd45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:30.844831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.845497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-270edc93-8151-4857-b70f-ff11867199fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:30.847542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1004/1992] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:30 2022] DELETE /identity/v3/projects/cae93d6573734d7aa1c1dc42c2cdd45e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:30.852419 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635ffc5-ea9e-4c6f-b84c-beab3d20c499 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.852709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635ffc5-ea9e-4c6f-b84c-beab3d20c499 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.852980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635ffc5-ea9e-4c6f-b84c-beab3d20c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.874280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1635ffc5-ea9e-4c6f-b84c-beab3d20c499 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:30.875626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1635ffc5-ea9e-4c6f-b84c-beab3d20c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:30.953156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 989/1993] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:30.955713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:30.956097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:30.956263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:30.979358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:30.981397 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.009535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1005/1994] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:31.011001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635ffc5-ea9e-4c6f-b84c-beab3d20c499 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.023409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635ffc5-ea9e-4c6f-b84c-beab3d20c499 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.030105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.030718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.030900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.031249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.032111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:31.032390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.034180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.035881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.037272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.052240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0aca-8ea8-4910-be34-901fdfea028d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.058322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.059353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.059633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.059907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] PATH_INFO: `/v3/projects/1decfffe06f047069d94963481bd4c16` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.061935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1decfffe06f047069d94963481bd4c16)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.063670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 990/1995] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:38:31.064338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.064538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.079879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506a60e-3d4d-4abd-8517-6184c0bf08a6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.085911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.086538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.086888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.087338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.088067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.093124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.118482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:31.122339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1decfffe06f047069d94963481bd4c16', 'request_id': 'req-2eb26076-0718-4391-a971-4ee4070e8b43'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:31.130230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1decfffe06f047069d94963481bd4c16', 'request_id': 'req-2eb26076-0718-4391-a971-4ee4070e8b43'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:31.132400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 991/1996] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:31.136568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.139008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1decfffe06f047069d94963481bd4c16', 'request_id': 'req-2eb26076-0718-4391-a971-4ee4070e8b43'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:31.153774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] The token cache is being invalidate because project 1decfffe06f047069d94963481bd4c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:31.154088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:31.154747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2eb26076-0718-4391-a971-4ee4070e8b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:31.156335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1006/1997] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:31 2022] DELETE /identity/v3/projects/1decfffe06f047069d94963481bd4c16 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:31.161964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7076007-4c33-4ec8-8d62-26f2c45afbdb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.162329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7076007-4c33-4ec8-8d62-26f2c45afbdb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.162734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7076007-4c33-4ec8-8d62-26f2c45afbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.185430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a7076007-4c33-4ec8-8d62-26f2c45afbdb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:31.186728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a7076007-4c33-4ec8-8d62-26f2c45afbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.232186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f16711-564c-4e8b-b204-3d3277086e9e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.237443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.238072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.238357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.238633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.239341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.241283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.271964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 992/1998] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:31.272140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1007/1999] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:31.275007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.279116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738132-94a5-4de0-9ff0-9ecd160a948a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.279396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738132-94a5-4de0-9ff0-9ecd160a948a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.279865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738132-94a5-4de0-9ff0-9ecd160a948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.280597 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.295141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8d157-0eed-4aad-aaa1-d1a8f2227451 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.300809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.301492 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.302089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.302089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.302739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.304403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.308783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b7738132-94a5-4de0-9ff0-9ecd160a948a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:31.309867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b7738132-94a5-4de0-9ff0-9ecd160a948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.318965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 993/2000] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:31.319138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1008/2001] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:31.321715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.322358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738132-94a5-4de0-9ff0-9ecd160a948a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.333865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738132-94a5-4de0-9ff0-9ecd160a948a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.334314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2124-b010-4050-ac72-aa984c72ddf0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.339274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.341052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.341171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.341281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.341281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.341420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.341784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.341901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:31.341980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.342182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.343005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.343600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.344848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.355992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1009/2002] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:31.359045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 994/2003] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:31.363217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.366764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.373873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377862c7-e370-4a08-aba9-3bd82b39f50d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.380169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5f521-8455-4654-8ba1-85976069e96d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.382148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.382783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.383096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.383371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.384035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.385754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1583557-f494-4254-8ec5-7a9527ca600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.386270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.387213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583557-f494-4254-8ec5-7a9527ca600c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.387567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583557-f494-4254-8ec5-7a9527ca600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.387918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583557-f494-4254-8ec5-7a9527ca600c admin admin] PATH_INFO: `/v3/projects/9052987cf4124b2db30b366e20164eb7/users/4092c58fb729457dbcf0551c0bb56058/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.402986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:31.406840 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1583557-f494-4254-8ec5-7a9527ca600c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9052987cf4124b2db30b366e20164eb7, user_id=4092c58fb729457dbcf0551c0bb56058, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.409622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1583557-f494-4254-8ec5-7a9527ca600c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.437496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1010/2004] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:31.449436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 995/2005] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:31 2022] PUT /identity/v3/projects/9052987cf4124b2db30b366e20164eb7/users/4092c58fb729457dbcf0551c0bb56058/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:31.449660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.458582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb42ad0-c504-4a58-b36d-bda2957c79b4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.459096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb42ad0-c504-4a58-b36d-bda2957c79b4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.459549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb42ad0-c504-4a58-b36d-bda2957c79b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.491989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2bb42ad0-c504-4a58-b36d-bda2957c79b4 None None] MFA Rules not processed for user `4092c58fb729457dbcf0551c0bb56058`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:31.493216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2bb42ad0-c504-4a58-b36d-bda2957c79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.524859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651884d-e21c-4cb2-83e9-b92c05e3db29 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.534152 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.535198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.535198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.535414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.536141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.538173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.574627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1011/2006] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:31.579656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.597286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811774c-201c-46f7-9e7f-6b699b2850b8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.598409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 996/2007] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:31.603198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb42ad0-c504-4a58-b36d-bda2957c79b4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.605853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.606552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.606831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.607155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.607888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.610028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.616903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb42ad0-c504-4a58-b36d-bda2957c79b4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.624098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.624896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.625239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.625516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.626331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.628463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.637442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1012/2008] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:31.642817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.658812 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86808db8-b5e8-4ffb-8627-05270de12e4f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.669618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.670410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.671613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.672380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.673587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.675650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.677184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 997/2009] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:31.678056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.690465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:31.693390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1013/2010] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:31.694578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.706522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe58dec-a725-422e-8cc5-39181b0715cc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.778569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024736-1fa5-4f46-a66b-e3fe9baa048d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.783974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f0cf6-5332-4177-ac07-cc6bafac489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.784613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f0cf6-5332-4177-ac07-cc6bafac489b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.784893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f0cf6-5332-4177-ac07-cc6bafac489b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.785241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f0cf6-5332-4177-ac07-cc6bafac489b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.785916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f0cf6-5332-4177-ac07-cc6bafac489b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.787893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.788033 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f0cf6-5332-4177-ac07-cc6bafac489b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.788588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.788872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.789153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] PATH_INFO: `/v3/projects/b835872f62f5429da7cb1f705015c03b/users/961ce81ef74e45fbb3f809bf776165ca/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.807864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b835872f62f5429da7cb1f705015c03b, user_id=961ce81ef74e45fbb3f809bf776165ca, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.811453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.813505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 998/2011] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:31.815059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699d20-cf1d-4f7d-ba8e-d8e255a8a728 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.815368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699d20-cf1d-4f7d-ba8e-d8e255a8a728 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.815660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699d20-cf1d-4f7d-ba8e-d8e255a8a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.828554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1014/2012] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:31 2022] PUT /identity/v3/projects/b835872f62f5429da7cb1f705015c03b/users/961ce81ef74e45fbb3f809bf776165ca/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:31.829594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.835401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-69699d20-cf1d-4f7d-ba8e-d8e255a8a728 None None] MFA Rules not processed for user `3e1c8b1e8375478888a9a7358bad9bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:31.836598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-69699d20-cf1d-4f7d-ba8e-d8e255a8a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.881185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:31.891119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 999/2013] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:31.892327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.892615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.892885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.905131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e39b15-a440-4abd-84b4-9d2c18cd43a4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.909895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.910525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.910810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.911115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.911813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.913554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.924683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1015/2014] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:31.924869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] MFA Rules not processed for user `961ce81ef74e45fbb3f809bf776165ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:31.926126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:31.928773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:31.939144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be515b78-faf8-4622-8dc7-2faab90daa7e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:31.944492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:31.945680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:31.946049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:31.946526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] PATH_INFO: `/v3/projects/4c335190092949d4a5d2bf6710186f13/users/0d8d980c2c6441aa9749b7103a27c04b/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:31.965219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c335190092949d4a5d2bf6710186f13, user_id=0d8d980c2c6441aa9749b7103a27c04b, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:31.968380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:31.984488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1016/2015] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:31 2022] PUT /identity/v3/projects/4c335190092949d4a5d2bf6710186f13/users/0d8d980c2c6441aa9749b7103a27c04b/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:31.988211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:32.003146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1000/2016] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:32.010541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:32.013328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:32.058710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:32.064715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39fa29-f240-4573-8f5e-9f631b3fc787 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:32.070369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:32.071173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:32.071529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:32.071878 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:32.072703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:32.075184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:32.086344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1017/2017] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:32.090473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:32.100645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656b845-508c-49b5-9dec-d49f0faf22e5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:32.103520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced33129-1ca5-406e-bde7-e14fde761ce2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:32.106731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93294488-ae06-4046-b2ce-19525c06c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:32.107444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294488-ae06-4046-b2ce-19525c06c0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:32.107725 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294488-ae06-4046-b2ce-19525c06c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:32.108004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294488-ae06-4046-b2ce-19525c06c0c9 admin admin] PATH_INFO: `/v3/projects/4c335190092949d4a5d2bf6710186f13/users/0d8d980c2c6441aa9749b7103a27c04b/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:32.110090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93294488-ae06-4046-b2ce-19525c06c0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c335190092949d4a5d2bf6710186f13, user_id=0d8d980c2c6441aa9749b7103a27c04b, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:32.112788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93294488-ae06-4046-b2ce-19525c06c0c9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:32.127960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1018/2018] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:32 2022] PUT /identity/v3/projects/4c335190092949d4a5d2bf6710186f13/users/0d8d980c2c6441aa9749b7103a27c04b/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:32.138353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:32.138665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:32.138999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:32.169543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] MFA Rules not processed for user `0d8d980c2c6441aa9749b7103a27c04b`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:32.170781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:32.174894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:32.175730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:32.176012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:32.176687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:32.245199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:32.246885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:32.247782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1019/2019] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:32.257163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1001/2020] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:32.258567 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:32.260444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:32.286988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:32.328848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2201fb-478d-4855-8f35-980cfa98a7ff None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:32.332489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb090fa-cd43-4fbb-a216-54471600ee3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:32.333302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb090fa-cd43-4fbb-a216-54471600ee3a service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:32.333588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb090fa-cd43-4fbb-a216-54471600ee3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:32.333866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb090fa-cd43-4fbb-a216-54471600ee3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:32.400796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb090fa-cd43-4fbb-a216-54471600ee3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:32.403086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb090fa-cd43-4fbb-a216-54471600ee3a service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:32.413014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1020/2021] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:32.762751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:32.765283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:32.787793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba39231-a94a-435c-89a2-7ea60521ad4c service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:32.861084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:32.861778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:32.862090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:32.862334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] PATH_INFO: `/v3/users/fafd8db86971461ba705384692e0b709` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:32.863979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafd8db86971461ba705384692e0b709)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:32.867056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:32.880992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:32.978745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafd8db86971461ba705384692e0b709'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:32.979005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafd8db86971461ba705384692e0b709'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:32.993385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafd8db86971461ba705384692e0b709'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.003882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafd8db86971461ba705384692e0b709'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.004901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafd8db86971461ba705384692e0b709'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.028389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1002/2022] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:32 2022] DELETE /identity/v3/users/fafd8db86971461ba705384692e0b709 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:33.033130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:33.033573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:33.034048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:33.054274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:33.055543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:33.117314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1021/2023] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:33.128238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:33.129642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:33.191473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9cabe-93ad-4752-9759-96bbed28ee60 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:33.195881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:33.196626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:33.196968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:33.197267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:33.209061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:33.210769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:33.221639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1003/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:33.502491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:33.504019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:33.516961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cba3b-3932-4e20-b546-0906d3f3d72c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:33.522329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:33.523017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:33.523301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:33.523579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] PATH_INFO: `/v3/projects/9437096768884037a82e905acd378145` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:33.524857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9437096768884037a82e905acd378145)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:33.526846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:33.573328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9437096768884037a82e905acd378145', 'request_id': 'req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.579727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9437096768884037a82e905acd378145', 'request_id': 'req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.587229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9437096768884037a82e905acd378145', 'request_id': 'req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.596643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:33.600409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] The token cache is being invalidate because project 9437096768884037a82e905acd378145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:33.601047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.602365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.604533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1022/2025] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:33 2022] DELETE /identity/v3/projects/9437096768884037a82e905acd378145 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:33.609201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:33.619660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e3082-a0ae-47ce-beb3-63c50cf938a8 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:33.700199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:33.700961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:33.701314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:33.701657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] PATH_INFO: `/v3/users/720a5ea9aa2e49afbf908cc9f2648dd0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:33.702918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=720a5ea9aa2e49afbf908cc9f2648dd0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:33.704927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:33.742545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:33.762036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720a5ea9aa2e49afbf908cc9f2648dd0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.762794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720a5ea9aa2e49afbf908cc9f2648dd0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.772347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720a5ea9aa2e49afbf908cc9f2648dd0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.780965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720a5ea9aa2e49afbf908cc9f2648dd0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.784068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720a5ea9aa2e49afbf908cc9f2648dd0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:33.805574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1004/2026] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:33 2022] DELETE /identity/v3/users/720a5ea9aa2e49afbf908cc9f2648dd0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:34.296943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:34.300292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:34.347800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16a99-0d09-4eeb-8605-73f86fbe5b0e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:34.431437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:34.432143 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:34.432469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:34.432747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] PATH_INFO: `/v3/projects/dafff5b127b94c92a07d057af6c5aba5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:34.434197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafff5b127b94c92a07d057af6c5aba5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:34.436360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:34.502397 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafff5b127b94c92a07d057af6c5aba5', 'request_id': 'req-6e000baa-038f-4391-9fb4-08023878f00b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.508560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafff5b127b94c92a07d057af6c5aba5', 'request_id': 'req-6e000baa-038f-4391-9fb4-08023878f00b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.524265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafff5b127b94c92a07d057af6c5aba5', 'request_id': 'req-6e000baa-038f-4391-9fb4-08023878f00b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.537709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] The token cache is being invalidate because project dafff5b127b94c92a07d057af6c5aba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:34.538001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.538668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.540465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1023/2027] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:34 2022] DELETE /identity/v3/projects/dafff5b127b94c92a07d057af6c5aba5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:34.544588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:34.546231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:34.559317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc675e-0b30-49bd-95e2-0a2cb689af37 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:34.625448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:34.626129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:34.626455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:34.627089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] PATH_INFO: `/v3/users/78dc692769404dc78c07bc47939bc8c9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:34.628338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78dc692769404dc78c07bc47939bc8c9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:34.630332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:34.686057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78dc692769404dc78c07bc47939bc8c9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.686694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78dc692769404dc78c07bc47939bc8c9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.695856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78dc692769404dc78c07bc47939bc8c9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.706891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78dc692769404dc78c07bc47939bc8c9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.707671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78dc692769404dc78c07bc47939bc8c9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:34.731125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1005/2028] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:34 2022] DELETE /identity/v3/users/78dc692769404dc78c07bc47939bc8c9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:35.106720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.108287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:35.131362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e000baa-038f-4391-9fb4-08023878f00b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.194741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.195441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.195722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.195995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] PATH_INFO: `/v3/projects/6be9f03f252a4c448fed164c7a7707b3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.197158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be9f03f252a4c448fed164c7a7707b3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.200352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.257719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:35.267826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.269900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:35.278115 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be9f03f252a4c448fed164c7a7707b3', 'request_id': 'req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.285950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be9f03f252a4c448fed164c7a7707b3', 'request_id': 'req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.290946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732a249-f938-4edb-98ec-9e580ba76c19 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.298517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be9f03f252a4c448fed164c7a7707b3', 'request_id': 'req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.319696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] The token cache is being invalidate because project 6be9f03f252a4c448fed164c7a7707b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:35.320058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.320654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b6606bc8-7c8c-4d98-9a42-53c02dedaaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.328112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1024/2029] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:35 2022] DELETE /identity/v3/projects/6be9f03f252a4c448fed164c7a7707b3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:35.329554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15e791-8a64-4c37-b849-05187d5bd25f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.329857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15e791-8a64-4c37-b849-05187d5bd25f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.330117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15e791-8a64-4c37-b849-05187d5bd25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.343882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:35.354676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-cf15e791-8a64-4c37-b849-05187d5bd25f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:35.356767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-cf15e791-8a64-4c37-b849-05187d5bd25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:35.393577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.395998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.396452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.396806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] PATH_INFO: `/v3/users/961ce81ef74e45fbb3f809bf776165ca` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.398241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961ce81ef74e45fbb3f809bf776165ca)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.400475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.452382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1025/2030] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:35.463170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6678d1-b110-4428-89c5-4a2611c724cd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.463882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6678d1-b110-4428-89c5-4a2611c724cd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.464818 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6678d1-b110-4428-89c5-4a2611c724cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.480332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961ce81ef74e45fbb3f809bf776165ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.481426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961ce81ef74e45fbb3f809bf776165ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.486536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8b6678d1-b110-4428-89c5-4a2611c724cd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:35.487789 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8b6678d1-b110-4428-89c5-4a2611c724cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:35.492354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961ce81ef74e45fbb3f809bf776165ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.505793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1026/2031] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:35.507043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6678d1-b110-4428-89c5-4a2611c724cd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.508770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961ce81ef74e45fbb3f809bf776165ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.520161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6f77de78-1852-4c26-a4fe-46cf47a89718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961ce81ef74e45fbb3f809bf776165ca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:35.520865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6678d1-b110-4428-89c5-4a2611c724cd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.527565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.539179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.539179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.539179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.539179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:35.539179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.539179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.548756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1027/2032] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:35.560260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.562865 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1006/2033] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:35 2022] DELETE /identity/v3/users/961ce81ef74e45fbb3f809bf776165ca => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:35.563013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:35.567091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.567624 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.568075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.577732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78974307-9f22-4945-aa42-64f23f5ea1b3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.591756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:35.592967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:35.670536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.671486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.671767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.672039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.672791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.675400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.679466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1007/2034] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:35.686569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.688077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:35.716675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1028/2035] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:35 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:35.721358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.762761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:35.764100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:35.769086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35592d-7755-4839-b989-1be2b369bab2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.813706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0b804-6c56-4934-9227-b8bcf9c6406d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.819823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.820454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.820734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.821006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.821668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.824196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.844606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.845324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.845602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.845874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.849806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1029/2036] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:35 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:35.858260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.860238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.861923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.873839 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d677-a2ea-4059-983d-574080b677bc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.874586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1008/2037] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:35.878963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.879594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.879878 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.880156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.880905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.883197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.899689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1030/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:35.906155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:35.926977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff657c-080d-4e7b-87d5-e990749e73f3 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:35.940557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f5c21-7712-47a6-87f3-f46be2760b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:35.942283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5c21-7712-47a6-87f3-f46be2760b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:35.942622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5c21-7712-47a6-87f3-f46be2760b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:35.942906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5c21-7712-47a6-87f3-f46be2760b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:35.944830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f5c21-7712-47a6-87f3-f46be2760b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:35.949373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f5c21-7712-47a6-87f3-f46be2760b2e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:35.974248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1009/2039] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:35.978465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.012858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c883132-49bc-4120-a3f2-fb37144d09df admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.018271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.019005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.019294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.019838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] PATH_INFO: `/v3/projects/1c3cd8561eff4dffa05f00bd88d4c6d9/users/f1111a1eb7e041e985bd131a8e3874c5/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.038744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3cd8561eff4dffa05f00bd88d4c6d9, user_id=f1111a1eb7e041e985bd131a8e3874c5, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.042291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.064557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1031/2040] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:35 2022] PUT /identity/v3/projects/1c3cd8561eff4dffa05f00bd88d4c6d9/users/f1111a1eb7e041e985bd131a8e3874c5/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:36.077889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.078379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.078656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.114344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] MFA Rules not processed for user `f1111a1eb7e041e985bd131a8e3874c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:36.115995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:36.189166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1010/2041] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:36.203154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.204941 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:36.208230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.209670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:36.268731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6892-65a4-49d9-bc7c-59c64c28d29e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.272834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda92d06-e345-4f14-ba16-cc805df66d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.273501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda92d06-e345-4f14-ba16-cc805df66d8e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.273788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda92d06-e345-4f14-ba16-cc805df66d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.274063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda92d06-e345-4f14-ba16-cc805df66d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.283409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda92d06-e345-4f14-ba16-cc805df66d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.284849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda92d06-e345-4f14-ba16-cc805df66d8e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.286096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ccbc3-34cf-41bb-b1aa-01f8c39c4af6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.290860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.291577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.291856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.292135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] PATH_INFO: `/v3/projects/b835872f62f5429da7cb1f705015c03b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.294036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b835872f62f5429da7cb1f705015c03b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.295614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1032/2042] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:36.295997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.329022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:36.345994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b835872f62f5429da7cb1f705015c03b', 'request_id': 'req-da3471dd-fa95-4579-ad36-894af6553c3e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:36.352201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b835872f62f5429da7cb1f705015c03b', 'request_id': 'req-da3471dd-fa95-4579-ad36-894af6553c3e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:36.357800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b835872f62f5429da7cb1f705015c03b', 'request_id': 'req-da3471dd-fa95-4579-ad36-894af6553c3e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:36.370359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] The token cache is being invalidate because project b835872f62f5429da7cb1f705015c03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:36.371368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:36.372199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da3471dd-fa95-4579-ad36-894af6553c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:36.373932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1011/2043] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:36 2022] DELETE /identity/v3/projects/b835872f62f5429da7cb1f705015c03b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:36.379677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0e41-cbbf-4c2f-a3f5-6a88c2145f6b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.380012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0e41-cbbf-4c2f-a3f5-6a88c2145f6b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.380324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0e41-cbbf-4c2f-a3f5-6a88c2145f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.400373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-02bc0e41-cbbf-4c2f-a3f5-6a88c2145f6b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:36.401598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-02bc0e41-cbbf-4c2f-a3f5-6a88c2145f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:36.476089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1033/2044] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:36.483974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdac787-58cd-4172-84a0-31011bf78384 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.484275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdac787-58cd-4172-84a0-31011bf78384 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.484585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdac787-58cd-4172-84a0-31011bf78384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.507695 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bfdac787-58cd-4172-84a0-31011bf78384 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:36.508949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bfdac787-58cd-4172-84a0-31011bf78384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:36.517892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1012/2045] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:36.523176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0e41-cbbf-4c2f-a3f5-6a88c2145f6b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.539025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0e41-cbbf-4c2f-a3f5-6a88c2145f6b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.546503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.547262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.547546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.547824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.548557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:36.548865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.550527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.566454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1034/2046] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:36.571354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdac787-58cd-4172-84a0-31011bf78384 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.595220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdac787-58cd-4172-84a0-31011bf78384 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.602179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.602811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.603722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.604051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.605311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.607297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.660551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1013/2047] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:36 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:36.662597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.673578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed48588-12bd-4fe7-95ce-6f77b7c313b2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.682714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:36.736080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.736627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.736908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.737179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.737843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.739828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.763452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1035/2048] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:36 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:36.767659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.778772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed94cd-4e56-472f-adb1-2d8eaffdd882 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.783544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.784212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.784507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.784791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.785482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.787159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.797118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1014/2049] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:36.800959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.811704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f40f-34b1-4929-b65e-d6eb75c1ec31 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.816344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2203c-6ecc-4985-80ca-e3f64ab9563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.816980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2203c-6ecc-4985-80ca-e3f64ab9563e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.817260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2203c-6ecc-4985-80ca-e3f64ab9563e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.817531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2203c-6ecc-4985-80ca-e3f64ab9563e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.818214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2203c-6ecc-4985-80ca-e3f64ab9563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.819869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2203c-6ecc-4985-80ca-e3f64ab9563e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.830668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1036/2050] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:36.834889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:36.845373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944196c7-346f-44ae-83d0-26cfa543d3f0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:36.849954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:36.850636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.850919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.851229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] PATH_INFO: `/v3/projects/54408b45491040c386fb031af275c2e3/users/c9e2a35dd64540cf9867185283f54839/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.865547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54408b45491040c386fb031af275c2e3, user_id=c9e2a35dd64540cf9867185283f54839, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:36.868229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:36.882589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1015/2051] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:36 2022] PUT /identity/v3/projects/54408b45491040c386fb031af275c2e3/users/c9e2a35dd64540cf9867185283f54839/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:36.894962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:36.895267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:36.895545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:36.924029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] MFA Rules not processed for user `c9e2a35dd64540cf9867185283f54839`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:36.925260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:36.994170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1037/2052] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:36.999464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.075940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370011-e444-47b5-b250-c2e96150e011 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.086354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.086897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.087267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.087661 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.088513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.091121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.091609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.093156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:37.128754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1016/2053] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:36 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:37.129669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.169522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e153-432f-4358-bb6a-46050308a49c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.179146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:37.209734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cbc20-2855-4659-b737-88edc5ec9ade admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.210489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:37.220025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.221218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.221838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.222384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.223584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.225838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.228943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.229566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.229863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.230357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.232237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:37.252686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1017/2054] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:37 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:37.256337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.270418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182740c-71ca-4f42-893a-634733a4f321 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.276173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.277541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.277888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.278850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.280044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.282460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.300728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1018/2055] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:38:37.301362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.302204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.302654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.313659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1038/2056] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:37.315049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d867317-7e45-41a0-b34c-e7428d498d77 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.320177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.320874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.321216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.321522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] PATH_INFO: `/v3/projects/34c9259efb694a5f84466a8cbf5f4d66/users/fbf0b705e3df47f59f4fa2100a43b167/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.340195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c9259efb694a5f84466a8cbf5f4d66, user_id=fbf0b705e3df47f59f4fa2100a43b167, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.342917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.360539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1019/2057] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:37 2022] PUT /identity/v3/projects/34c9259efb694a5f84466a8cbf5f4d66/users/fbf0b705e3df47f59f4fa2100a43b167/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:37.364561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.377092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6b03-aaba-4d6c-996c-653c5817377a service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.457857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bc394-b3c0-4c1f-9b1e-c10592a9cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.458605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc394-b3c0-4c1f-9b1e-c10592a9cf71 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.459466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc394-b3c0-4c1f-9b1e-c10592a9cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.459466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc394-b3c0-4c1f-9b1e-c10592a9cf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.460140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bc394-b3c0-4c1f-9b1e-c10592a9cf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.461773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bc394-b3c0-4c1f-9b1e-c10592a9cf71 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.477020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1039/2058] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:37.478779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.493920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edc0e-fe6c-4059-a1a8-b12176e3ecf1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.501790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.502750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.503182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.503614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] PATH_INFO: `/v3/projects/34c9259efb694a5f84466a8cbf5f4d66/users/fbf0b705e3df47f59f4fa2100a43b167/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.505816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c9259efb694a5f84466a8cbf5f4d66, user_id=fbf0b705e3df47f59f4fa2100a43b167, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.508710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.523537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1020/2059] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:37 2022] PUT /identity/v3/projects/34c9259efb694a5f84466a8cbf5f4d66/users/fbf0b705e3df47f59f4fa2100a43b167/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:37.535016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a317b5c-ac9e-4b7d-9b0f-da50c6bf25f2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.535016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a317b5c-ac9e-4b7d-9b0f-da50c6bf25f2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.535548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a317b5c-ac9e-4b7d-9b0f-da50c6bf25f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.568486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1a317b5c-ac9e-4b7d-9b0f-da50c6bf25f2 None None] MFA Rules not processed for user `fbf0b705e3df47f59f4fa2100a43b167`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:37.569840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1a317b5c-ac9e-4b7d-9b0f-da50c6bf25f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:37.705739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1040/2060] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:37.713613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:37.715956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:37.825220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18481b-f185-4fed-a119-0616a51d4819 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:37.829469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:37.830105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:37.830386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:37.830717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:37.845293 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:37.848107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:37.872417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1021/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:38.254486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a317b5c-ac9e-4b7d-9b0f-da50c6bf25f2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:38.265497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a317b5c-ac9e-4b7d-9b0f-da50c6bf25f2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:38.274001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf0b705e3df47f59f4fa2100a43b167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34c9259efb694a5f84466a8cbf5f4d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:38.274796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:38.275191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:38.275632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:38.278271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:38.278271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:38.281091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:38.290272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:38.299580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1041/2062] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:38:38.300855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:38.311993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3773c8c-b550-48be-8373-8b7d05776d7a service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:38.318205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf0b705e3df47f59f4fa2100a43b167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34c9259efb694a5f84466a8cbf5f4d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:38.318834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:38.319317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:38.319764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:38.320435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:38.322887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:38.368730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1022/2063] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:38 2022] POST /identity/v3/projects => generated 354 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:38.374391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:38.390430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a877-a4db-45d0-b67b-42bd5ff298e4 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:38.483721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf0b705e3df47f59f4fa2100a43b167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34c9259efb694a5f84466a8cbf5f4d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:38.484604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:38.484962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:38.485310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:38.486120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:38.486505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:38.489355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:38.511819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1042/2064] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:38.562260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:38.572908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97bb20-e3a1-4dfe-981f-0b7f7cacae79 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:38.580200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbf0b705e3df47f59f4fa2100a43b167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34c9259efb694a5f84466a8cbf5f4d66', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:38.580958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:38.581275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:38.581550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] PATH_INFO: `/v3/projects/7e5f135e187f47788d62916fc4fd776f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:38.582731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e5f135e187f47788d62916fc4fd776f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:38.585395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:38.656119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5f135e187f47788d62916fc4fd776f', 'request_id': 'req-4cbc0bea-58c0-460a-9805-c6ef92415782'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:38.664371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5f135e187f47788d62916fc4fd776f', 'request_id': 'req-4cbc0bea-58c0-460a-9805-c6ef92415782'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:38.665867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:38.673549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5f135e187f47788d62916fc4fd776f', 'request_id': 'req-4cbc0bea-58c0-460a-9805-c6ef92415782'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:38.694345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] The token cache is being invalidate because project 7e5f135e187f47788d62916fc4fd776f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:38.694666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:38.695351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cbc0bea-58c0-460a-9805-c6ef92415782 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:38.697620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1023/2065] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:38 2022] DELETE /identity/v3/projects/7e5f135e187f47788d62916fc4fd776f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:38.983105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:38.986441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:39.072231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8ce1f-f3fc-401f-aaac-5ca83378f868 tempest-VolumeQuotaClassesTest-966888174 tempest-VolumeQuotaClassesTest-966888174-project-admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:39.148858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:39.149511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:39.149824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:39.150083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] PATH_INFO: `/v3/users/c9e2a35dd64540cf9867185283f54839` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:39.151298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e2a35dd64540cf9867185283f54839)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:39.153293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:39.192532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:39.202393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e2a35dd64540cf9867185283f54839'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.209221 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e2a35dd64540cf9867185283f54839'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.209897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e2a35dd64540cf9867185283f54839'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.217419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e2a35dd64540cf9867185283f54839'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.230755 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e2a35dd64540cf9867185283f54839'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.236820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1043/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:38 2022] DELETE /identity/v3/users/c9e2a35dd64540cf9867185283f54839 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:39.241622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:39.242004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:39.242295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:39.263661 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:39.265072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:39.328735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1024/2067] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:39.338361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:39.339934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:39.399457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93964c5-a76a-422b-a12f-e0769893bb21 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:39.403235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:39.403889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:39.404169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:39.404441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:39.413784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:39.415346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:39.425628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1044/2068] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:39.724414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:39.725862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:39.746191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10871b6-955f-472c-b074-6496cf172bf6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:39.751470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:39.752129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:39.752413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:39.752694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] PATH_INFO: `/v3/projects/54408b45491040c386fb031af275c2e3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:39.753861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54408b45491040c386fb031af275c2e3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:39.755851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:39.806099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54408b45491040c386fb031af275c2e3', 'request_id': 'req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.812579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54408b45491040c386fb031af275c2e3', 'request_id': 'req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.818247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54408b45491040c386fb031af275c2e3', 'request_id': 'req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.830749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] The token cache is being invalidate because project 54408b45491040c386fb031af275c2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:39.831071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.831704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.833196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1025/2069] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:39 2022] DELETE /identity/v3/projects/54408b45491040c386fb031af275c2e3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:39.837344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:39.850376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b3eb3-8ac5-460b-b6ed-56444bda2946 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:39.909800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:39.910452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:39.910730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:39.911041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] PATH_INFO: `/v3/users/fbf0b705e3df47f59f4fa2100a43b167` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:39.912216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf0b705e3df47f59f4fa2100a43b167)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:39.914180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:39.964729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf0b705e3df47f59f4fa2100a43b167'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.972609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf0b705e3df47f59f4fa2100a43b167'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.973314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf0b705e3df47f59f4fa2100a43b167'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.975863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:39.982294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf0b705e3df47f59f4fa2100a43b167'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:39.995686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-54245fa7-f223-4b3e-8e68-d5b8d6814ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf0b705e3df47f59f4fa2100a43b167'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:40.002022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1045/2070] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:39 2022] DELETE /identity/v3/users/fbf0b705e3df47f59f4fa2100a43b167 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:40.459564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:40.461877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:40.477379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f9d7-03b3-4aee-b77f-8de6d232da1b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:40.539938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:40.540580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:40.540860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:40.541133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] PATH_INFO: `/v3/projects/34c9259efb694a5f84466a8cbf5f4d66` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:40.542871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c9259efb694a5f84466a8cbf5f4d66)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:40.544908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:40.553535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:40.621754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c9259efb694a5f84466a8cbf5f4d66', 'request_id': 'req-42722d47-1b50-4a12-8416-63c93e17b645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:40.632175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c9259efb694a5f84466a8cbf5f4d66', 'request_id': 'req-42722d47-1b50-4a12-8416-63c93e17b645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:40.642311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c9259efb694a5f84466a8cbf5f4d66', 'request_id': 'req-42722d47-1b50-4a12-8416-63c93e17b645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:40.658723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] The token cache is being invalidate because project 34c9259efb694a5f84466a8cbf5f4d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:40.659154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:40.660105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-42722d47-1b50-4a12-8416-63c93e17b645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:40.661822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1026/2071] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:40 2022] DELETE /identity/v3/projects/34c9259efb694a5f84466a8cbf5f4d66 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:40.668506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1d584-e846-4662-a0b3-f52bcadafb7c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:40.668802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1d584-e846-4662-a0b3-f52bcadafb7c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:40.669286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1d584-e846-4662-a0b3-f52bcadafb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:40.701239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6fb1d584-e846-4662-a0b3-f52bcadafb7c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:40.702484 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6fb1d584-e846-4662-a0b3-f52bcadafb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:40.775446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1046/2072] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:40.787084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c752-dc0d-4466-9012-d3e24181ffc0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:40.787377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c752-dc0d-4466-9012-d3e24181ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:40.787662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c752-dc0d-4466-9012-d3e24181ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:40.810275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5007c752-dc0d-4466-9012-d3e24181ffc0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:40.812199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5007c752-dc0d-4466-9012-d3e24181ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:40.820820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1027/2073] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:40.826054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1d584-e846-4662-a0b3-f52bcadafb7c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:40.836122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1d584-e846-4662-a0b3-f52bcadafb7c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:40.842208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:40.842830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:40.843172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:40.843443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:40.844138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:40.844446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:40.846117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:40.859407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1047/2074] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:38:40.863773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c752-dc0d-4466-9012-d3e24181ffc0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:40.873360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c752-dc0d-4466-9012-d3e24181ffc0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:40.878685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:40.879382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:40.879655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:40.879922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:40.880581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:40.882746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:40.913912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1028/2075] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:40 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:40.915370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:40.925969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585470f-02ae-4544-83c4-e9402bdb452b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:40.986995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:40.987606 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:40.987888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:40.988161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:40.988821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:40.990736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.013512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1048/2076] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:40 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:41.017536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.028806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bea0d-ff85-480e-8aee-690fff4a6a48 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.033318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.033922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.034199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.034469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.035170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.036772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.047311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1029/2077] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:41.051633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.061706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e681-ec79-4bd2-9192-7602da4e0dc2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.066368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4574-fb6e-409f-9a5a-207093833456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.067006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4574-fb6e-409f-9a5a-207093833456 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.067292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4574-fb6e-409f-9a5a-207093833456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.067567 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4574-fb6e-409f-9a5a-207093833456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.068258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d4574-fb6e-409f-9a5a-207093833456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.069856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d4574-fb6e-409f-9a5a-207093833456 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.081361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1049/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:41.085432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.096242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e7ef-487c-4979-b4dc-3a4fde2aa629 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.100828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.101470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.101746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.102018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] PATH_INFO: `/v3/projects/07b0cc75c5214b818d263c01a933857f/users/13bae2ac06f14aaaba781618e9facaa7/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.116749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b0cc75c5214b818d263c01a933857f, user_id=13bae2ac06f14aaaba781618e9facaa7, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.119502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.132975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1030/2079] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:41 2022] PUT /identity/v3/projects/07b0cc75c5214b818d263c01a933857f/users/13bae2ac06f14aaaba781618e9facaa7/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:41.144083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e81b0a-51b2-43da-baea-44911aa47055 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.144621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e81b0a-51b2-43da-baea-44911aa47055 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.144904 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e81b0a-51b2-43da-baea-44911aa47055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.173726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a4e81b0a-51b2-43da-baea-44911aa47055 None None] MFA Rules not processed for user `13bae2ac06f14aaaba781618e9facaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:41.174971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a4e81b0a-51b2-43da-baea-44911aa47055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:41.207099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:41.244590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1050/2080] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:41.249335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.314593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47470bd-cc1f-4ab3-9b4c-eca9725b4b50 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.319270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.319881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.320157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.320425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.321201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.323125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.352472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1031/2081] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:41 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:41.356090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e81b0a-51b2-43da-baea-44911aa47055 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.366807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e81b0a-51b2-43da-baea-44911aa47055 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.432767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.434041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.434319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.434719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.435289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.437848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.462167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1051/2082] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:41 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:41.466437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.477245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86601-3fe4-4c96-a23f-3fa8669be1b0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.482217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.482837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.483155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.483427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.484124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.485737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.498481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1032/2083] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:41.503182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.515464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eb1db-9c8c-4e25-8b4f-1ef244691d4e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.521280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.522025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.522417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.522709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] PATH_INFO: `/v3/projects/88d8df06f57b4879bec790990ed40afa/users/7a8a900a9d2c41a59844e622cd126694/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.541905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d8df06f57b4879bec790990ed40afa, user_id=7a8a900a9d2c41a59844e622cd126694, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.545079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.560382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1052/2084] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:41 2022] PUT /identity/v3/projects/88d8df06f57b4879bec790990ed40afa/users/7a8a900a9d2c41a59844e622cd126694/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:41.564612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.575235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c8d61-e6d4-41f4-98b8-7408a14bd0ee admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.579636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:41.639023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d052f4-bf9a-4720-bbba-08117a15171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.639652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d052f4-bf9a-4720-bbba-08117a15171e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.639940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d052f4-bf9a-4720-bbba-08117a15171e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.640270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d052f4-bf9a-4720-bbba-08117a15171e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.640969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d052f4-bf9a-4720-bbba-08117a15171e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.643596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d052f4-bf9a-4720-bbba-08117a15171e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.655926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1033/2085] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:41.660108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.670258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3daf36-b312-4c6e-b3fa-ffc8af5be509 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.674765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.675447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.675722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.675991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] PATH_INFO: `/v3/projects/88d8df06f57b4879bec790990ed40afa/users/7a8a900a9d2c41a59844e622cd126694/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.677905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d8df06f57b4879bec790990ed40afa, user_id=7a8a900a9d2c41a59844e622cd126694, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.680551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.691003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1053/2086] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:41 2022] PUT /identity/v3/projects/88d8df06f57b4879bec790990ed40afa/users/7a8a900a9d2c41a59844e622cd126694/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:41.702102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae9d7c-5af5-4d26-8871-daa529f8adfd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.702392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae9d7c-5af5-4d26-8871-daa529f8adfd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.702669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae9d7c-5af5-4d26-8871-daa529f8adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.729585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-59ae9d7c-5af5-4d26-8871-daa529f8adfd None None] MFA Rules not processed for user `7a8a900a9d2c41a59844e622cd126694`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:41.731356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-59ae9d7c-5af5-4d26-8871-daa529f8adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:41.801958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1034/2087] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:41.813150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.814960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:41.874881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a56bc0-c9c1-467a-a856-b0c3da5fced6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.878612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.879325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.879551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.879823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:41.889333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:41.890960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:41.901585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1054/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:41.949919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae9d7c-5af5-4d26-8871-daa529f8adfd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:41.959560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae9d7c-5af5-4d26-8871-daa529f8adfd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:41.963274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea645-bdc7-4868-81e2-02b811a16b10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:41.963964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea645-bdc7-4868-81e2-02b811a16b10 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:41.964370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea645-bdc7-4868-81e2-02b811a16b10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:41.964711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea645-bdc7-4868-81e2-02b811a16b10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:42.031049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fea645-bdc7-4868-81e2-02b811a16b10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:42.032523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fea645-bdc7-4868-81e2-02b811a16b10 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:42.044909 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1035/2089] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:38:42.435627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:42.437059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:42.470618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:42.505266 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb1f00-cedb-4ef2-865a-c17da44161a4 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:42.509829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:42.510553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:42.510832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:42.511710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] PATH_INFO: `/v3/users/4092c58fb729457dbcf0551c0bb56058` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:42.512879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4092c58fb729457dbcf0551c0bb56058)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:42.514813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:42.561968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4092c58fb729457dbcf0551c0bb56058'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:42.568816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4092c58fb729457dbcf0551c0bb56058'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:42.569481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4092c58fb729457dbcf0551c0bb56058'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:42.577451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4092c58fb729457dbcf0551c0bb56058'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:42.589844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4092c58fb729457dbcf0551c0bb56058'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:42.596184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1055/2090] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:42 2022] DELETE /identity/v3/users/4092c58fb729457dbcf0551c0bb56058 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:42.601010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:42.601446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:42.601570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:42.621723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:42.622973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:42.645808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:42.692943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1036/2091] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:42.704138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:42.705569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:42.765660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beece36-f433-44e2-b576-2f43c7ac3169 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:42.773025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:42.773721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:42.774080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:42.774420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:42.784735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:42.786179 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:42.797296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1056/2092] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:43.072048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:43.073567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:43.091645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dff41-2490-425f-8f47-8c280f1958d0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:43.096676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:43.097294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:43.097733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:43.097994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] PATH_INFO: `/v3/projects/9052987cf4124b2db30b366e20164eb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:43.099234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9052987cf4124b2db30b366e20164eb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:43.101193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:43.152567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9052987cf4124b2db30b366e20164eb7', 'request_id': 'req-55b02be6-e19e-4155-94b1-c7914be1b9e8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.159996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9052987cf4124b2db30b366e20164eb7', 'request_id': 'req-55b02be6-e19e-4155-94b1-c7914be1b9e8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.166138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9052987cf4124b2db30b366e20164eb7', 'request_id': 'req-55b02be6-e19e-4155-94b1-c7914be1b9e8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.178560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] The token cache is being invalidate because project 9052987cf4124b2db30b366e20164eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:43.178854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.179509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.181022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1037/2093] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:43 2022] DELETE /identity/v3/projects/9052987cf4124b2db30b366e20164eb7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:43.185465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:43.196680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944295b-c858-4852-b928-71ff3fcd83ff service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:43.241816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:43.256560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:43.257215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:43.257496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:43.257770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] PATH_INFO: `/v3/users/0d8d980c2c6441aa9749b7103a27c04b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:43.258998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8d980c2c6441aa9749b7103a27c04b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:43.261478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:43.310047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8d980c2c6441aa9749b7103a27c04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.317150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8d980c2c6441aa9749b7103a27c04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.317917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8d980c2c6441aa9749b7103a27c04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.325772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8d980c2c6441aa9749b7103a27c04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.338398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fd22da8c-edde-417c-9f04-ec04c2ac17ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8d980c2c6441aa9749b7103a27c04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.346205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1057/2094] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:43 2022] DELETE /identity/v3/users/0d8d980c2c6441aa9749b7103a27c04b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:43.751751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:43.754735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:43.775515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b02be6-e19e-4155-94b1-c7914be1b9e8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:43.853341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:43.855519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:43.856063 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:43.856633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] PATH_INFO: `/v3/projects/4c335190092949d4a5d2bf6710186f13` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:43.858451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c335190092949d4a5d2bf6710186f13)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:43.860460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:43.931030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c335190092949d4a5d2bf6710186f13', 'request_id': 'req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.932381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:43.939788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c335190092949d4a5d2bf6710186f13', 'request_id': 'req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.950006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c335190092949d4a5d2bf6710186f13', 'request_id': 'req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.965965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] The token cache is being invalidate because project 4c335190092949d4a5d2bf6710186f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:43.966257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.966900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26a2da56-8f35-46c6-be8d-c0b99c3d7c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:43.968800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1038/2095] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:43 2022] DELETE /identity/v3/projects/4c335190092949d4a5d2bf6710186f13 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:43.974300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaddc7-bf60-417d-8a4a-299dce0322c1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:43.974767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaddc7-bf60-417d-8a4a-299dce0322c1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:43.974862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaddc7-bf60-417d-8a4a-299dce0322c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:43.997957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bceaddc7-bf60-417d-8a4a-299dce0322c1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:43.999420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bceaddc7-bf60-417d-8a4a-299dce0322c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:44.070662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1058/2096] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:44.081007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1806c-7b07-4fc1-97ad-fa91b751f95a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.081007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1806c-7b07-4fc1-97ad-fa91b751f95a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.081278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1806c-7b07-4fc1-97ad-fa91b751f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.101979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-96a1806c-7b07-4fc1-97ad-fa91b751f95a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:44.103226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-96a1806c-7b07-4fc1-97ad-fa91b751f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:44.115737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1039/2097] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:44.119787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaddc7-bf60-417d-8a4a-299dce0322c1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:44.129882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaddc7-bf60-417d-8a4a-299dce0322c1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:44.135558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:44.136910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.137250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.137664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.138307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:44.138611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:44.140347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:44.153899 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1059/2098] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:44.158464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1806c-7b07-4fc1-97ad-fa91b751f95a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:44.168602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1806c-7b07-4fc1-97ad-fa91b751f95a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:44.173363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:44.173982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.174254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.174524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.175211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:44.179155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:44.219425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1040/2099] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:44 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:44.223739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:44.244184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff22fc6-c8c8-46c8-ae11-6ed52b576718 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:44.307264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:44.315464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:44.316108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.316925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.317274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.318157 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:44.325443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:44.350970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1060/2100] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:44 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:44.354374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:44.365142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949037d-5b98-4af0-ad7e-4b091719e1b3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:44.371022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:44.371655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.371936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.372206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.372898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:44.374518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:44.387088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1041/2101] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:44.391276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:44.406279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c6b7-3eaf-492d-8860-cd3b572c0472 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:44.412838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fb83a-0021-4af7-8fea-ec3b9b3f3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:44.413728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fb83a-0021-4af7-8fea-ec3b9b3f3534 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.414135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fb83a-0021-4af7-8fea-ec3b9b3f3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.414476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fb83a-0021-4af7-8fea-ec3b9b3f3534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.415325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fb83a-0021-4af7-8fea-ec3b9b3f3534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:44.417849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fb83a-0021-4af7-8fea-ec3b9b3f3534 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:44.435421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1061/2102] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:44.440053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:44.455871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446dad4-7e4c-488e-95c2-c1606aea74fd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:44.463746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:44.464703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.465284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.465417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] PATH_INFO: `/v3/projects/e6b31089f83e40ee8318983d6f47987b/users/b881f26e768141089a65062a10581632/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.484994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b31089f83e40ee8318983d6f47987b, user_id=b881f26e768141089a65062a10581632, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:44.488199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:44.504834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1042/2103] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:44 2022] PUT /identity/v3/projects/e6b31089f83e40ee8318983d6f47987b/users/b881f26e768141089a65062a10581632/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:44.522884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.523125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.523405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.560439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] MFA Rules not processed for user `b881f26e768141089a65062a10581632`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:44.561938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:44.639167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1062/2104] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:44.650784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:44.654975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:44.718459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d200-75f4-4f60-934a-e3aab0d73229 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:44.722230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0ed6b-9054-476e-a3e0-870cf6e96739 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:44.723203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0ed6b-9054-476e-a3e0-870cf6e96739 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:44.723479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0ed6b-9054-476e-a3e0-870cf6e96739 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:44.723790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0ed6b-9054-476e-a3e0-870cf6e96739 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:44.733512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0ed6b-9054-476e-a3e0-870cf6e96739 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:44.735035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0ed6b-9054-476e-a3e0-870cf6e96739 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:44.744297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1043/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:45.643973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:45.645883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:45.725954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa09917-6220-4bbf-ad4e-3ac41cb6021d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:45.731236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:45.731890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:45.732173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:45.732446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] PATH_INFO: `/v3/users/13bae2ac06f14aaaba781618e9facaa7` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:45.733617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13bae2ac06f14aaaba781618e9facaa7)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:45.735608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:45.795982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13bae2ac06f14aaaba781618e9facaa7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:45.802714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13bae2ac06f14aaaba781618e9facaa7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:45.803391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13bae2ac06f14aaaba781618e9facaa7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:45.811241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13bae2ac06f14aaaba781618e9facaa7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:45.813233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:45.827499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13bae2ac06f14aaaba781618e9facaa7'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:45.838024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1063/2106] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:45 2022] DELETE /identity/v3/users/13bae2ac06f14aaaba781618e9facaa7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:45.843335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:45.843881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:45.843881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:45.863436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:45.864644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:45.925321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1044/2107] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:45.936032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:45.937450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:45.994697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd228ef-fe1d-4b0c-a113-90cdba441762 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:45.998838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:45.999559 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:45.999843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:46.000127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:46.013634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:46.015382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:46.026118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1064/2108] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:46.593703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:46.595819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:46.609352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf8b17-f161-427f-8f74-302fa77ffa67 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:46.613613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:46.614268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:46.614697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:46.615013 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] PATH_INFO: `/v3/projects/07b0cc75c5214b818d263c01a933857f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:46.616241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b0cc75c5214b818d263c01a933857f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:46.618170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:46.639963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:46.676814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b0cc75c5214b818d263c01a933857f', 'request_id': 'req-51814933-de95-4a87-b386-5248351a0d7e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.683706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b0cc75c5214b818d263c01a933857f', 'request_id': 'req-51814933-de95-4a87-b386-5248351a0d7e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.689440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b0cc75c5214b818d263c01a933857f', 'request_id': 'req-51814933-de95-4a87-b386-5248351a0d7e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.712824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] The token cache is being invalidate because project 07b0cc75c5214b818d263c01a933857f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:46.713113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.713784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.715580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1045/2109] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:46 2022] DELETE /identity/v3/projects/07b0cc75c5214b818d263c01a933857f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:46.721098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:46.739961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa3678-3afb-4553-8702-39b58dacd5cc service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:46.823070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:46.824802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:46.825086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:46.825410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] PATH_INFO: `/v3/users/7a8a900a9d2c41a59844e622cd126694` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:46.826815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8a900a9d2c41a59844e622cd126694)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:46.828999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:46.907465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8a900a9d2c41a59844e622cd126694'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.914679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8a900a9d2c41a59844e622cd126694'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.915372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8a900a9d2c41a59844e622cd126694'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.923100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8a900a9d2c41a59844e622cd126694'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.935853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5c99c32f-a64d-4da9-bc89-6e549272b883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8a900a9d2c41a59844e622cd126694'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:46.942089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1065/2110] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:46 2022] DELETE /identity/v3/users/7a8a900a9d2c41a59844e622cd126694 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:47.218341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:47.219831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:47.233920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814933-de95-4a87-b386-5248351a0d7e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:47.291601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:47.293166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.293392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.293675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] PATH_INFO: `/v3/projects/88d8df06f57b4879bec790990ed40afa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.295087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d8df06f57b4879bec790990ed40afa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:47.297239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:47.364706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d8df06f57b4879bec790990ed40afa', 'request_id': 'req-39d330cd-364b-4917-8661-25b540da5dcf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:47.374341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d8df06f57b4879bec790990ed40afa', 'request_id': 'req-39d330cd-364b-4917-8661-25b540da5dcf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:47.381967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d8df06f57b4879bec790990ed40afa', 'request_id': 'req-39d330cd-364b-4917-8661-25b540da5dcf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:47.399667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] The token cache is being invalidate because project 88d8df06f57b4879bec790990ed40afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:47.400393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:47.401955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-39d330cd-364b-4917-8661-25b540da5dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:47.407616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1046/2111] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:47 2022] DELETE /identity/v3/projects/88d8df06f57b4879bec790990ed40afa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:47.412304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ae47-39e5-4497-9dd8-cb19cc11cf2f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.412596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ae47-39e5-4497-9dd8-cb19cc11cf2f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.412876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ae47-39e5-4497-9dd8-cb19cc11cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.424283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:47.440607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f5b2ae47-39e5-4497-9dd8-cb19cc11cf2f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:47.442097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f5b2ae47-39e5-4497-9dd8-cb19cc11cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:47.535337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1066/2112] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:47.539621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192e6a6-f177-419c-a451-e5cc09a7a9c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.539999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192e6a6-f177-419c-a451-e5cc09a7a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.540337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192e6a6-f177-419c-a451-e5cc09a7a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.562990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d192e6a6-f177-419c-a451-e5cc09a7a9c3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:47.564307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d192e6a6-f177-419c-a451-e5cc09a7a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:47.572490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1047/2113] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:47.576838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ae47-39e5-4497-9dd8-cb19cc11cf2f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:47.586994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ae47-39e5-4497-9dd8-cb19cc11cf2f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:47.595335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:47.595831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.596109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.596379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.597210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:47.597511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:47.599155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:47.616111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1067/2114] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:47.616497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192e6a6-f177-419c-a451-e5cc09a7a9c3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:47.626878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192e6a6-f177-419c-a451-e5cc09a7a9c3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:47.631714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:47.632356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.632658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.632949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.633615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:47.635847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:47.663359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1048/2115] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:47 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:47.668671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:47.678725 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c48e6-20e3-4301-90b7-fe65d3152c9c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:47.736882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:47.737571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.737761 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.738030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.738690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:47.740634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:47.762550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1068/2116] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:47 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:47.766686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:47.773954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:47.779155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368369-0d4d-4657-b45e-1bfb38ca657c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:47.785141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:47.785953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.786434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.786978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.787773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:47.793853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:47.805253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1049/2117] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:47.809835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:47.819913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb7e6-47fe-4bdb-9f74-854619c62d0e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:47.825356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23bdc3-1bba-4e52-b7b1-03db9f26447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:47.825956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23bdc3-1bba-4e52-b7b1-03db9f26447f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.826233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23bdc3-1bba-4e52-b7b1-03db9f26447f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.826504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23bdc3-1bba-4e52-b7b1-03db9f26447f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.827232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23bdc3-1bba-4e52-b7b1-03db9f26447f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:47.828822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23bdc3-1bba-4e52-b7b1-03db9f26447f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:47.840002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1069/2118] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:47.844131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:47.854536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be5be-699e-4e0d-85ef-4ea79162cbfc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:47.860607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf7ba-a5bc-4ef7-b766-9a00d4c53f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:47.861283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf7ba-a5bc-4ef7-b766-9a00d4c53f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.861561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf7ba-a5bc-4ef7-b766-9a00d4c53f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.861832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf7ba-a5bc-4ef7-b766-9a00d4c53f2e admin admin] PATH_INFO: `/v3/projects/8e318ab682e2495daa52e642e0f1a272/users/0a8f800c9f52432ca4c5b5aa712bfabd/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.878911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf7ba-a5bc-4ef7-b766-9a00d4c53f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e318ab682e2495daa52e642e0f1a272, user_id=0a8f800c9f52432ca4c5b5aa712bfabd, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:47.881904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf7ba-a5bc-4ef7-b766-9a00d4c53f2e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:47.897042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1050/2119] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:47 2022] PUT /identity/v3/projects/8e318ab682e2495daa52e642e0f1a272/users/0a8f800c9f52432ca4c5b5aa712bfabd/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:47.908917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16498ae-37e5-4125-b9be-9cc927e3ac56 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.909222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16498ae-37e5-4125-b9be-9cc927e3ac56 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.909476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16498ae-37e5-4125-b9be-9cc927e3ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.940100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c16498ae-37e5-4125-b9be-9cc927e3ac56 None None] MFA Rules not processed for user `0a8f800c9f52432ca4c5b5aa712bfabd`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:47.941781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c16498ae-37e5-4125-b9be-9cc927e3ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:47.971460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5652a77-0eb0-461e-8f05-185d2d495fda None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:47.971745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5652a77-0eb0-461e-8f05-185d2d495fda None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:47.972016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5652a77-0eb0-461e-8f05-185d2d495fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:47.990302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a5652a77-0eb0-461e-8f05-185d2d495fda None None] MFA Rules not processed for user `3e1c8b1e8375478888a9a7358bad9bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:47.991534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a5652a77-0eb0-461e-8f05-185d2d495fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:48.016432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:48.022216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1070/2120] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:48.025598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16498ae-37e5-4125-b9be-9cc927e3ac56 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.048572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1051/2121] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:38:48.100346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16498ae-37e5-4125-b9be-9cc927e3ac56 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.105986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.106610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.106887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.107192 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.107855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:48.110025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:48.141663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1071/2122] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:48 2022] POST /identity/v3/projects => generated 401 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:38:48.143127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5652a77-0eb0-461e-8f05-185d2d495fda None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.155408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5652a77-0eb0-461e-8f05-185d2d495fda None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.218411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.219160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.219402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.220163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.220480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:48.222442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:48.244510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1052/2123] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:48 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:48.248868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.259809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cf08f-6190-402b-861f-5589eb15b4cc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.264787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.265504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.265848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.266124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.266839 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:48.268478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:48.280304 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1072/2124] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:48.284603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.295257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5053ab-ff7f-4b76-a619-2d55eef236f4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.299878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.300557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.300835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.301102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] PATH_INFO: `/v3/projects/602c9bde8cb147a294682177d31fac6f/users/04e5bfcb002b42bf9d3def376b7a070a/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.316210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602c9bde8cb147a294682177d31fac6f, user_id=04e5bfcb002b42bf9d3def376b7a070a, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:48.318942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:48.333352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1053/2125] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:48 2022] PUT /identity/v3/projects/602c9bde8cb147a294682177d31fac6f/users/04e5bfcb002b42bf9d3def376b7a070a/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:48.338483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.352628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925dd3-a5ae-4890-971e-3b3821c81865 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.413345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f067a93-ece7-412b-b733-74708dc2d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.414054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067a93-ece7-412b-b733-74708dc2d97a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.414403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067a93-ece7-412b-b733-74708dc2d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.414746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067a93-ece7-412b-b733-74708dc2d97a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.415534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f067a93-ece7-412b-b733-74708dc2d97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:48.417271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f067a93-ece7-412b-b733-74708dc2d97a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:48.438084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1073/2126] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:48.445769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.460398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ba5d0-2f7c-45d2-a1f3-840c6bb0a705 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.466555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.467283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.467567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.467842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] PATH_INFO: `/v3/projects/602c9bde8cb147a294682177d31fac6f/users/04e5bfcb002b42bf9d3def376b7a070a/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.469773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602c9bde8cb147a294682177d31fac6f, user_id=04e5bfcb002b42bf9d3def376b7a070a, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:48.472479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:48.484543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1054/2127] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:48 2022] PUT /identity/v3/projects/602c9bde8cb147a294682177d31fac6f/users/04e5bfcb002b42bf9d3def376b7a070a/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:48.497024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a40a-f123-4721-887a-85bd653c2785 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.497341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a40a-f123-4721-887a-85bd653c2785 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.497628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a40a-f123-4721-887a-85bd653c2785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.525409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8e26a40a-f123-4721-887a-85bd653c2785 None None] MFA Rules not processed for user `04e5bfcb002b42bf9d3def376b7a070a`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:48.526811 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8e26a40a-f123-4721-887a-85bd653c2785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:48.611952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:48.629496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1074/2128] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:48.641612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.643846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:48.711571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:48.763795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc3afa-c29e-428b-9789-5d3beda53d83 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.768501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.769172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.769673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.769950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:48.791262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:48.793523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:48.806622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1055/2129] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:48.923579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a40a-f123-4721-887a-85bd653c2785 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:48.935136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a40a-f123-4721-887a-85bd653c2785 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:48.939498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228e0f7-825e-4bd3-a9b1-02d62fd7bf13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:48.940238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228e0f7-825e-4bd3-a9b1-02d62fd7bf13 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:48.940526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228e0f7-825e-4bd3-a9b1-02d62fd7bf13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:48.940803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228e0f7-825e-4bd3-a9b1-02d62fd7bf13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:49.022301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228e0f7-825e-4bd3-a9b1-02d62fd7bf13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:49.023905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228e0f7-825e-4bd3-a9b1-02d62fd7bf13 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:49.039816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1075/2130] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:53.392710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:53.473660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed699-ffbb-4d95-a61e-ff3f5cb76528 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:53.479377 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:53.481007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:53.481289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:53.481566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] PATH_INFO: `/v3/users/0a8f800c9f52432ca4c5b5aa712bfabd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:53.482743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8f800c9f52432ca4c5b5aa712bfabd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:53.484764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:53.538475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8f800c9f52432ca4c5b5aa712bfabd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:53.539212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8f800c9f52432ca4c5b5aa712bfabd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:53.547294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8f800c9f52432ca4c5b5aa712bfabd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:53.554485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8f800c9f52432ca4c5b5aa712bfabd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:53.555179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8f800c9f52432ca4c5b5aa712bfabd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:53.573421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1056/2131] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:53 2022] DELETE /identity/v3/users/0a8f800c9f52432ca4c5b5aa712bfabd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:53.577951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:53.578424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:53.578535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:53.599594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:53.601172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:53.676966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1076/2132] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:53.687512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:53.688925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:53.744161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:53.750788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db828e-f3ec-4cc9-9791-105b77b7eac9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:53.755826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:53.757012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:53.757941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:53.758491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:53.771413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:53.772927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:53.782642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1057/2133] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:54.061716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:54.063400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:54.078228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cffa8d-3ddb-4ac3-a409-3584d68584e2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:54.082972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:54.083610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:54.083897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:54.084177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] PATH_INFO: `/v3/projects/8e318ab682e2495daa52e642e0f1a272` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:54.085350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e318ab682e2495daa52e642e0f1a272)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:54.087310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:54.137461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e318ab682e2495daa52e642e0f1a272', 'request_id': 'req-582c1db1-1b5c-45d6-b760-3b62ea19937e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.142780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e318ab682e2495daa52e642e0f1a272', 'request_id': 'req-582c1db1-1b5c-45d6-b760-3b62ea19937e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.150506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e318ab682e2495daa52e642e0f1a272', 'request_id': 'req-582c1db1-1b5c-45d6-b760-3b62ea19937e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.162791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] The token cache is being invalidate because project 8e318ab682e2495daa52e642e0f1a272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:54.163118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.163771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.165299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1077/2134] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:54 2022] DELETE /identity/v3/projects/8e318ab682e2495daa52e642e0f1a272 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:54.170212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:54.179814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2d72-0f8d-4730-8b4e-d63d28e5d2fd service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:54.245562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:54.246324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:54.246607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:54.246881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] PATH_INFO: `/v3/users/04e5bfcb002b42bf9d3def376b7a070a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:54.248101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e5bfcb002b42bf9d3def376b7a070a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:54.250043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:54.299457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e5bfcb002b42bf9d3def376b7a070a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.300115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e5bfcb002b42bf9d3def376b7a070a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.307866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e5bfcb002b42bf9d3def376b7a070a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.315472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e5bfcb002b42bf9d3def376b7a070a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.316304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-794206c6-80a4-4037-97dc-564d30724bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e5bfcb002b42bf9d3def376b7a070a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.346438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1058/2135] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:54 2022] DELETE /identity/v3/users/04e5bfcb002b42bf9d3def376b7a070a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:54.664110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:54.665590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:54.679294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c1db1-1b5c-45d6-b760-3b62ea19937e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:54.693099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:54.740908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:54.741567 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:54.741868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:54.742128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] PATH_INFO: `/v3/projects/602c9bde8cb147a294682177d31fac6f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:54.743336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602c9bde8cb147a294682177d31fac6f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:54.745876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:54.796583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602c9bde8cb147a294682177d31fac6f', 'request_id': 'req-6119b52f-a919-43a8-8dc4-a83cdfee5155'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.802195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602c9bde8cb147a294682177d31fac6f', 'request_id': 'req-6119b52f-a919-43a8-8dc4-a83cdfee5155'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.810765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602c9bde8cb147a294682177d31fac6f', 'request_id': 'req-6119b52f-a919-43a8-8dc4-a83cdfee5155'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.822595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] The token cache is being invalidate because project 602c9bde8cb147a294682177d31fac6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:54.822893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.823809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6119b52f-a919-43a8-8dc4-a83cdfee5155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:54.825403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1078/2136] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:54 2022] DELETE /identity/v3/projects/602c9bde8cb147a294682177d31fac6f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:54.830564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811d03-4968-4515-b858-c2ffc0598ce9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:54.831090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811d03-4968-4515-b858-c2ffc0598ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:54.831199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811d03-4968-4515-b858-c2ffc0598ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:54.851039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bd811d03-4968-4515-b858-c2ffc0598ce9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:54.852262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bd811d03-4968-4515-b858-c2ffc0598ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:54.910632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1059/2137] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:54.919417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633335-e262-4a65-b2e9-18f4c3a9b6e9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:54.919719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633335-e262-4a65-b2e9-18f4c3a9b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:54.919992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633335-e262-4a65-b2e9-18f4c3a9b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:54.942247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9d633335-e262-4a65-b2e9-18f4c3a9b6e9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:54.943501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9d633335-e262-4a65-b2e9-18f4c3a9b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:54.951453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1079/2138] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:54.955632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811d03-4968-4515-b858-c2ffc0598ce9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:54.966068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811d03-4968-4515-b858-c2ffc0598ce9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:54.970560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:54.971201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:54.971475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:54.971741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:54.972447 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:38:54.972747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:54.974333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:54.981803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:54.989303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1060/2139] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:38:54.994371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d633335-e262-4a65-b2e9-18f4c3a9b6e9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.004279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d633335-e262-4a65-b2e9-18f4c3a9b6e9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.008855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.009463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.009739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.010012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.010735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.012980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.039651 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1080/2140] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:54 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:55.044282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.054507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b287-8466-4899-937e-a83c39b4ad3f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.115959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.116575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.116850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.117119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.117771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.119722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.146999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1061/2141] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:55 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:55.149427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.160539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7040b-4e27-4001-8ce4-3dc5e6f954c4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.165491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.166102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.166379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.166653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.168082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.169682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.179946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1081/2142] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:55.184917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.195807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ebac-a08e-4726-89f2-6094d094f891 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.201785 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1b8b-e4fb-4af7-8ef7-1b986b875d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.202425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1b8b-e4fb-4af7-8ef7-1b986b875d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.202706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1b8b-e4fb-4af7-8ef7-1b986b875d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.203019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1b8b-e4fb-4af7-8ef7-1b986b875d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.203751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1b8b-e4fb-4af7-8ef7-1b986b875d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.205363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1b8b-e4fb-4af7-8ef7-1b986b875d2d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.217199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1062/2143] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:55.221400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.231913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840626-f653-4db2-947f-80c3f959e70c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.236492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.237146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.237424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.237698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] PATH_INFO: `/v3/projects/b16d1da231fb4923be64f663685aca88/users/4f1024bd99794ffd90ea54fdcc5e33a8/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.252800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16d1da231fb4923be64f663685aca88, user_id=4f1024bd99794ffd90ea54fdcc5e33a8, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.255503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.268122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1082/2144] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:55 2022] PUT /identity/v3/projects/b16d1da231fb4923be64f663685aca88/users/4f1024bd99794ffd90ea54fdcc5e33a8/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:55.278845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2963c-924d-4b1c-bbf5-3d3db02e7d8d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.279165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2963c-924d-4b1c-bbf5-3d3db02e7d8d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.279444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2963c-924d-4b1c-bbf5-3d3db02e7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.310684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-01a2963c-924d-4b1c-bbf5-3d3db02e7d8d None None] MFA Rules not processed for user `4f1024bd99794ffd90ea54fdcc5e33a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:55.312151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-01a2963c-924d-4b1c-bbf5-3d3db02e7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:55.377752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1063/2145] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:55.382416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.440366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:55.478007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dd8e4-2b26-4208-8ae1-ad528b5ce3c3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.485480 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.486146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.486444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.486714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.487549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.489583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.520232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1083/2146] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:38:55 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:55.521914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2963c-924d-4b1c-bbf5-3d3db02e7d8d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.542496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2963c-924d-4b1c-bbf5-3d3db02e7d8d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.613663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.614321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.614599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.614872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.615572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.617586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.629553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:55.642074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1064/2147] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:38:55 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:38:55.646268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.656663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb371-80fe-47b7-a972-4478c5298517 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.661309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.661981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.662319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.662596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.663382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.664962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.680607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1084/2148] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:55.681869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.693107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eaee2-9f02-471b-99e5-8d54c16bc068 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.697688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.699045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.699328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.699603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] PATH_INFO: `/v3/projects/f2f8b570a2a34e3a804f356bd9e56725/users/579d59a7cd724d44aacc4c215742dc2f/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.716299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f8b570a2a34e3a804f356bd9e56725, user_id=579d59a7cd724d44aacc4c215742dc2f, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.719023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.733968 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1065/2149] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:55 2022] PUT /identity/v3/projects/f2f8b570a2a34e3a804f356bd9e56725/users/579d59a7cd724d44aacc4c215742dc2f/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:38:55.737681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.747937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081113-01ac-42b0-8602-aa518d1ef1a8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.817090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6307-4d67-405e-b1a0-7926b53dc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.817717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6307-4d67-405e-b1a0-7926b53dc695 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.817999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6307-4d67-405e-b1a0-7926b53dc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.818275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6307-4d67-405e-b1a0-7926b53dc695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.819136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6307-4d67-405e-b1a0-7926b53dc695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.820739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6307-4d67-405e-b1a0-7926b53dc695 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.834240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1085/2150] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:38:55.837951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.849269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc89f4-ddc5-4e3c-b50e-a2c457abf5c3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:55.855594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:55.856341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.856549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.857031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] PATH_INFO: `/v3/projects/f2f8b570a2a34e3a804f356bd9e56725/users/579d59a7cd724d44aacc4c215742dc2f/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.859142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f8b570a2a34e3a804f356bd9e56725, user_id=579d59a7cd724d44aacc4c215742dc2f, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:55.861944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:55.873439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1066/2151] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:38:55 2022] PUT /identity/v3/projects/f2f8b570a2a34e3a804f356bd9e56725/users/579d59a7cd724d44aacc4c215742dc2f/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:55.885076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d4e6-2909-4f04-95bc-f14859324fd4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:55.885366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d4e6-2909-4f04-95bc-f14859324fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:55.885677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d4e6-2909-4f04-95bc-f14859324fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:55.913760 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-aaa9d4e6-2909-4f04-95bc-f14859324fd4 None None] MFA Rules not processed for user `579d59a7cd724d44aacc4c215742dc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:55.914991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aaa9d4e6-2909-4f04-95bc-f14859324fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:55.987103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1086/2152] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:55.997916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:55.999637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:56.060025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca711809-62ef-401a-aea8-e9a773603712 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:56.063700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea5bb9-c765-42ec-a012-dfd200dc0255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:56.064319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea5bb9-c765-42ec-a012-dfd200dc0255 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:56.064599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea5bb9-c765-42ec-a012-dfd200dc0255 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:56.064871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea5bb9-c765-42ec-a012-dfd200dc0255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:56.074390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea5bb9-c765-42ec-a012-dfd200dc0255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:56.076027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea5bb9-c765-42ec-a012-dfd200dc0255 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:56.087169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1067/2153] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:56.513131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9d4e6-2909-4f04-95bc-f14859324fd4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:56.560836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:56.583030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9d4e6-2909-4f04-95bc-f14859324fd4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:56.587694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:56.588356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:56.588639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:56.588915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] PATH_INFO: `/v3/users/4f1024bd99794ffd90ea54fdcc5e33a8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:56.590105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1024bd99794ffd90ea54fdcc5e33a8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:56.592161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:56.643093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1024bd99794ffd90ea54fdcc5e33a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:56.650071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1024bd99794ffd90ea54fdcc5e33a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:56.650731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1024bd99794ffd90ea54fdcc5e33a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:56.657790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1024bd99794ffd90ea54fdcc5e33a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:56.675443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1024bd99794ffd90ea54fdcc5e33a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:56.682100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1087/2154] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:56 2022] DELETE /identity/v3/users/4f1024bd99794ffd90ea54fdcc5e33a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:56.687214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:56.687502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:56.687771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:56.709209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:38:56.710517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:56.776007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1068/2155] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:38:56.789405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:56.793542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:56.850429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bda302-0030-4451-b4b9-9212e10f8b78 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:56.853729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:56.855151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:56.855325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:56.855477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:56.864745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:56.866181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:56.876970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1088/2156] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:38:57.168786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:57.170236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:57.182247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871daf1-0c81-4464-ac37-d01f49ccc0f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:57.188544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:57.189246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:57.189529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:57.189804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] PATH_INFO: `/v3/projects/b16d1da231fb4923be64f663685aca88` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:57.191074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16d1da231fb4923be64f663685aca88)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:57.193114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:57.240412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16d1da231fb4923be64f663685aca88', 'request_id': 'req-b82553e9-1e2a-4c91-9574-19b3cedcafb4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.247793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16d1da231fb4923be64f663685aca88', 'request_id': 'req-b82553e9-1e2a-4c91-9574-19b3cedcafb4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.249990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:57.256442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16d1da231fb4923be64f663685aca88', 'request_id': 'req-b82553e9-1e2a-4c91-9574-19b3cedcafb4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.273960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] The token cache is being invalidate because project b16d1da231fb4923be64f663685aca88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:57.273960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.273960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.273960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1069/2157] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:57 2022] DELETE /identity/v3/projects/b16d1da231fb4923be64f663685aca88 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:57.278797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:57.288594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7dff-9d3b-48c9-a9d0-13721bd2dcdd service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:57.343520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:57.344155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:57.344430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:57.344708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] PATH_INFO: `/v3/users/579d59a7cd724d44aacc4c215742dc2f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:57.345849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579d59a7cd724d44aacc4c215742dc2f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:57.347784 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:57.349986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:57.403371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579d59a7cd724d44aacc4c215742dc2f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.410239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579d59a7cd724d44aacc4c215742dc2f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.410981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579d59a7cd724d44aacc4c215742dc2f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.418297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579d59a7cd724d44aacc4c215742dc2f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.430985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579d59a7cd724d44aacc4c215742dc2f'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.437804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1089/2158] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:38:57 2022] DELETE /identity/v3/users/579d59a7cd724d44aacc4c215742dc2f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:38:57.721675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:38:57.723172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:38:57.741596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82553e9-1e2a-4c91-9574-19b3cedcafb4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:38:57.806525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:38:57.807096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:38:57.807373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:38:57.808214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] PATH_INFO: `/v3/projects/f2f8b570a2a34e3a804f356bd9e56725` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:38:57.809362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f8b570a2a34e3a804f356bd9e56725)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:38:57.811306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:38:57.869659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f8b570a2a34e3a804f356bd9e56725', 'request_id': 'req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.876884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f8b570a2a34e3a804f356bd9e56725', 'request_id': 'req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.882524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f8b570a2a34e3a804f356bd9e56725', 'request_id': 'req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.896373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] The token cache is being invalidate because project f2f8b570a2a34e3a804f356bd9e56725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:38:57.896714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.897279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ae9d5369-1081-4f36-ba3c-60a8d6a33cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:38:57.899039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1070/2159] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:38:57 2022] DELETE /identity/v3/projects/f2f8b570a2a34e3a804f356bd9e56725 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:39:07.434019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:07.842264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:07.844409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:07.857485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243e2e-641c-4f86-a0d9-c99be8f44ea2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:07.893015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:07.914637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:07.915331 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:07.915612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:07.915887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] PATH_INFO: `/v3/users/b881f26e768141089a65062a10581632` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:07.917058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b881f26e768141089a65062a10581632)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:07.919058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:07.963866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b881f26e768141089a65062a10581632'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:07.971263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b881f26e768141089a65062a10581632'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:07.971919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b881f26e768141089a65062a10581632'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:07.979958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b881f26e768141089a65062a10581632'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:07.991762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b881f26e768141089a65062a10581632'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:07.997481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1090/2160] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:39:07 2022] DELETE /identity/v3/users/b881f26e768141089a65062a10581632 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:08.001982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.002303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.002581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.022036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:08.023340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:08.081305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1071/2161] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:08.091093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.092675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:08.151279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d714-7a62-4fc6-b770-9ea2c8e86898 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.154857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb9751-e6ef-434b-8da1-bc0d7b578f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.155502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9751-e6ef-434b-8da1-bc0d7b578f31 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.155778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9751-e6ef-434b-8da1-bc0d7b578f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.156056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9751-e6ef-434b-8da1-bc0d7b578f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.165385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb9751-e6ef-434b-8da1-bc0d7b578f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.166811 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb9751-e6ef-434b-8da1-bc0d7b578f31 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:08.176235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1091/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:39:08.467518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.469227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:08.482264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9e1ed-ec46-4c07-b785-fda8a12908e8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.487582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.488243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.488533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.488851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] PATH_INFO: `/v3/projects/e6b31089f83e40ee8318983d6f47987b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.490346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b31089f83e40ee8318983d6f47987b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.492793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:08.552961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b31089f83e40ee8318983d6f47987b', 'request_id': 'req-bec16dd0-9882-4ef9-99b5-543a3fa97a02'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:08.559167 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b31089f83e40ee8318983d6f47987b', 'request_id': 'req-bec16dd0-9882-4ef9-99b5-543a3fa97a02'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:08.565767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b31089f83e40ee8318983d6f47987b', 'request_id': 'req-bec16dd0-9882-4ef9-99b5-543a3fa97a02'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:08.577751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] The token cache is being invalidate because project e6b31089f83e40ee8318983d6f47987b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:39:08.578596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:08.579244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bec16dd0-9882-4ef9-99b5-543a3fa97a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:08.580754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1072/2163] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:39:08 2022] DELETE /identity/v3/projects/e6b31089f83e40ee8318983d6f47987b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:08.585648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20582-525e-4cd0-87f8-aa76a27b784b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.586119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20582-525e-4cd0-87f8-aa76a27b784b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.586246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20582-525e-4cd0-87f8-aa76a27b784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.605701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a3f20582-525e-4cd0-87f8-aa76a27b784b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:08.606885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a3f20582-525e-4cd0-87f8-aa76a27b784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:08.624025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:08.669151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1092/2164] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:08.677539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bc9f9-6033-4750-b490-d7ddff0917c2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.677828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bc9f9-6033-4750-b490-d7ddff0917c2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.678108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bc9f9-6033-4750-b490-d7ddff0917c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.697944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-459bc9f9-6033-4750-b490-d7ddff0917c2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:08.699191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-459bc9f9-6033-4750-b490-d7ddff0917c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:08.707323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1073/2165] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:08.712660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20582-525e-4cd0-87f8-aa76a27b784b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.722576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20582-525e-4cd0-87f8-aa76a27b784b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.727233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.727840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.728118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.728391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.729084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:39:08.729385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.730997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:08.743412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1093/2166] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:39:08.747623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bc9f9-6033-4750-b490-d7ddff0917c2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.758676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bc9f9-6033-4750-b490-d7ddff0917c2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.763355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.763962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.764243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.764515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.765200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.767132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:08.793714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1074/2167] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:39:08 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:39:08.798471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.808532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c038e03-cbc3-436d-b3de-fe7a2cb68a7a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.864411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52163201-0492-4471-915a-60693f672edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.865036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52163201-0492-4471-915a-60693f672edd admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.865316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52163201-0492-4471-915a-60693f672edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.865593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52163201-0492-4471-915a-60693f672edd admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.866261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52163201-0492-4471-915a-60693f672edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.868205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52163201-0492-4471-915a-60693f672edd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:08.889094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1094/2168] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:39:08 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:39:08.893209 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.904012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3024c60-3184-4f89-987c-65d4dc661153 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.908796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.909410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.909688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.909959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.910676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.912304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:08.923240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1075/2169] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:39:08.927050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52163201-0492-4471-915a-60693f672edd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.938522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52163201-0492-4471-915a-60693f672edd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.943195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab1174-3c01-4a00-aaad-d3614a42f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.943792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab1174-3c01-4a00-aaad-d3614a42f91c admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.944066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab1174-3c01-4a00-aaad-d3614a42f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.944335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab1174-3c01-4a00-aaad-d3614a42f91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.945019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab1174-3c01-4a00-aaad-d3614a42f91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.946610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab1174-3c01-4a00-aaad-d3614a42f91c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:08.957260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1095/2170] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:39:08.961462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:08.972261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886e890-1053-4e5c-bc09-9658b60209fa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:08.976910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:08.977600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:08.977878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:08.978149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] PATH_INFO: `/v3/projects/9ddf91d159a84eb99c8fdcfb79d8074c/users/8f0fd0aca23e4b92b1346a22c89d85eb/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:08.993345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddf91d159a84eb99c8fdcfb79d8074c, user_id=8f0fd0aca23e4b92b1346a22c89d85eb, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:08.996077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:09.009775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1076/2171] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:39:08 2022] PUT /identity/v3/projects/9ddf91d159a84eb99c8fdcfb79d8074c/users/8f0fd0aca23e4b92b1346a22c89d85eb/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:09.079147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0264c-a6bc-477c-98ca-6705313ca887 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:09.079562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0264c-a6bc-477c-98ca-6705313ca887 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:09.080231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0264c-a6bc-477c-98ca-6705313ca887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:09.114959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-d0b0264c-a6bc-477c-98ca-6705313ca887 None None] MFA Rules not processed for user `8f0fd0aca23e4b92b1346a22c89d85eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:09.116281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d0b0264c-a6bc-477c-98ca-6705313ca887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:09.186873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1096/2172] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:09.198862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:09.200579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:09.223339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:09.266102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2c37-22e4-4bf7-9e0a-52f0c947afab admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:09.270201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:09.270970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:09.271258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:09.271532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:09.280349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:09.282571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:09.291800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1077/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:39:15.247786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:15.248228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:15.248228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:15.272442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:15.273692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:15.288372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:15.340284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1097/2174] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:39:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:15.385213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:15.386642 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:15.459749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164bad9-bfd1-46a1-8aa5-b525d81453a9 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:15.465335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7c3a-696c-4bc8-a127-34fda1d845b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:15.465895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7c3a-696c-4bc8-a127-34fda1d845b1 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:15.466175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7c3a-696c-4bc8-a127-34fda1d845b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:15.466447 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7c3a-696c-4bc8-a127-34fda1d845b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:15.474812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af7c3a-696c-4bc8-a127-34fda1d845b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:15.476665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af7c3a-696c-4bc8-a127-34fda1d845b1 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:15.485911 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1078/2175] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 18:39:16.369952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:16.371681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:16.473085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae406d-f88d-4ba8-98da-28078df2db3e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:16.480942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:16.481607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:16.481881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:16.482171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] PATH_INFO: `/v3/users/f1111a1eb7e041e985bd131a8e3874c5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:16.483463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1111a1eb7e041e985bd131a8e3874c5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:16.485723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:16.554508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1111a1eb7e041e985bd131a8e3874c5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:16.564349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1111a1eb7e041e985bd131a8e3874c5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:16.565123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1111a1eb7e041e985bd131a8e3874c5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:16.596123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1111a1eb7e041e985bd131a8e3874c5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:16.626411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1111a1eb7e041e985bd131a8e3874c5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:16.635877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1098/2176] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:39:16 2022] DELETE /identity/v3/users/f1111a1eb7e041e985bd131a8e3874c5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:39:16.660811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:16.662728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:16.663400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:16.711671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:16.713260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:16.788205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1079/2177] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:16.801142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:16.802727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:16.875532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:16.902519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9227-9581-42bc-b54a-5fc076bf87e9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:16.913492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10298b-80c7-432a-b0bc-61fa2bdee769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:16.914283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10298b-80c7-432a-b0bc-61fa2bdee769 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:16.914661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10298b-80c7-432a-b0bc-61fa2bdee769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:16.916942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10298b-80c7-432a-b0bc-61fa2bdee769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:16.928277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10298b-80c7-432a-b0bc-61fa2bdee769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:16.929734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10298b-80c7-432a-b0bc-61fa2bdee769 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:16.950705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1099/2178] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:39:17.348428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:17.350836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:17.368277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2b10e-f149-4004-ac05-7805b308a95c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:17.382158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:17.383193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:17.385450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:17.401406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] PATH_INFO: `/v3/projects/1c3cd8561eff4dffa05f00bd88d4c6d9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:17.403058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3cd8561eff4dffa05f00bd88d4c6d9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:17.406435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:17.496031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:17.500205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3cd8561eff4dffa05f00bd88d4c6d9', 'request_id': 'req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:17.514632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3cd8561eff4dffa05f00bd88d4c6d9', 'request_id': 'req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:17.527843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3cd8561eff4dffa05f00bd88d4c6d9', 'request_id': 'req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:17.570707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] The token cache is being invalidate because project 1c3cd8561eff4dffa05f00bd88d4c6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:39:17.571141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:17.572716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7f47bddf-dc4f-4b9e-b45e-3954bd11d6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:17.578768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1080/2179] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:39:17 2022] DELETE /identity/v3/projects/1c3cd8561eff4dffa05f00bd88d4c6d9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:17.583873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4264b1-e9af-49c8-b04b-e6652a4e461d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:17.584810 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4264b1-e9af-49c8-b04b-e6652a4e461d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:17.585390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4264b1-e9af-49c8-b04b-e6652a4e461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:17.622806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-da4264b1-e9af-49c8-b04b-e6652a4e461d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:17.624083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-da4264b1-e9af-49c8-b04b-e6652a4e461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:17.734801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1100/2180] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:17.743582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4d0b-a69c-4a40-ae1c-ad7b741edfcb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:17.744321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4d0b-a69c-4a40-ae1c-ad7b741edfcb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:17.744321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4d0b-a69c-4a40-ae1c-ad7b741edfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:17.769727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9c9d4d0b-a69c-4a40-ae1c-ad7b741edfcb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:17.771256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c9d4d0b-a69c-4a40-ae1c-ad7b741edfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:17.780499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1081/2181] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:17.785348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4264b1-e9af-49c8-b04b-e6652a4e461d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:17.795857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4264b1-e9af-49c8-b04b-e6652a4e461d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:17.802816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:17.803866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:17.804277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:17.804612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:17.805444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:39:17.805821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:17.808027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:17.830898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1101/2182] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:39:17.832585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4d0b-a69c-4a40-ae1c-ad7b741edfcb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:17.850118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4d0b-a69c-4a40-ae1c-ad7b741edfcb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:17.856458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:17.857337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:17.858028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:17.858464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:17.859505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:17.862417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:17.912903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1082/2183] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:39:17 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:39:17.916840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:17.933608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd2561-3a97-47a9-8568-ea804cfcbe10 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:18.042272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:18.042921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.043216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.043545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.044173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:18.046113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:18.073286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1102/2184] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:39:17 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:39:18.077208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:18.091896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d795f-e03d-4c9c-b7ee-e1ede3703def admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:18.100119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:18.101207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.101487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.101938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.102794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:18.104582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:18.120280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1083/2185] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:39:18.124621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:18.142701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3545798-46f0-4c09-8634-d7e6921c08ad admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:18.153960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8206d-6bde-41bd-bf7b-645d1838d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:18.154751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8206d-6bde-41bd-bf7b-645d1838d574 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.155067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8206d-6bde-41bd-bf7b-645d1838d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.155440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8206d-6bde-41bd-bf7b-645d1838d574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.156979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8206d-6bde-41bd-bf7b-645d1838d574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:18.159064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8206d-6bde-41bd-bf7b-645d1838d574 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:18.178527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1103/2186] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:39:18.179767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:18.194814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6d1b-a37f-4150-8ebc-33280b8ba564 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:18.204069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:18.205321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.205779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.206233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] PATH_INFO: `/v3/projects/6118c77181d04035b723c3e4f8547db3/users/03200481ea3f4568a73abf232e05e6ca/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.237532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6118c77181d04035b723c3e4f8547db3, user_id=03200481ea3f4568a73abf232e05e6ca, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:18.240499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:18.260709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1084/2187] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:39:18 2022] PUT /identity/v3/projects/6118c77181d04035b723c3e4f8547db3/users/03200481ea3f4568a73abf232e05e6ca/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:18.335440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b376-aabe-49c0-8c58-28ff7e32b468 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.335718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b376-aabe-49c0-8c58-28ff7e32b468 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.335997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b376-aabe-49c0-8c58-28ff7e32b468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.378699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2484b376-aabe-49c0-8c58-28ff7e32b468 None None] MFA Rules not processed for user `03200481ea3f4568a73abf232e05e6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:18.380047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2484b376-aabe-49c0-8c58-28ff7e32b468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:18.435686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:18.467674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1104/2188] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:39:18.480100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:18.481703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:18.557803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8ae3e-16a4-413f-a824-550c369c016d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:18.576727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701353-f311-4adf-a5bc-8cdabe9c87e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:18.577869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701353-f311-4adf-a5bc-8cdabe9c87e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.578245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701353-f311-4adf-a5bc-8cdabe9c87e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.579142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701353-f311-4adf-a5bc-8cdabe9c87e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.595768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1701353-f311-4adf-a5bc-8cdabe9c87e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:18.597818 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1701353-f311-4adf-a5bc-8cdabe9c87e4 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:18.619027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1085/2189] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:39:18.646905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b376-aabe-49c0-8c58-28ff7e32b468 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:18.723486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b376-aabe-49c0-8c58-28ff7e32b468 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:18.729173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:18.729919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.730254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.730663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] PATH_INFO: `/v3/users/03200481ea3f4568a73abf232e05e6ca` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.732028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=03200481ea3f4568a73abf232e05e6ca)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:18.735043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:18.848522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03200481ea3f4568a73abf232e05e6ca'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:18.861842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03200481ea3f4568a73abf232e05e6ca'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:18.863922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03200481ea3f4568a73abf232e05e6ca'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:18.879515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03200481ea3f4568a73abf232e05e6ca'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:18.898596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03200481ea3f4568a73abf232e05e6ca'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:18.935919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1105/2190] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:39:18 2022] DELETE /identity/v3/users/03200481ea3f4568a73abf232e05e6ca => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:18.946442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:18.946442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:18.946442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:18.968918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:18.970707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:19.060517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1086/2191] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:19.074129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:19.076000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:19.165025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7463d2-b94e-4919-aa86-42f9379edabb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:19.169167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:19.169909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:19.172506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:19.172821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:19.187052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:19.189373 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:19.203734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1106/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:39:19.736716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:19.738564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:19.775644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfa79d-ef01-4a1d-9695-df9fbeb46b13 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:19.786082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:19.794925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:19.795926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:19.796899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] PATH_INFO: `/v3/projects/6118c77181d04035b723c3e4f8547db3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:19.798856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] RBAC: Authorizing `identity:delete_project(project_id=6118c77181d04035b723c3e4f8547db3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:19.800983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:19.813735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:19.881369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6118c77181d04035b723c3e4f8547db3', 'request_id': 'req-7bef5c53-89a1-43b2-baa3-d5793cfeedad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:19.889173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6118c77181d04035b723c3e4f8547db3', 'request_id': 'req-7bef5c53-89a1-43b2-baa3-d5793cfeedad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:19.896712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6118c77181d04035b723c3e4f8547db3', 'request_id': 'req-7bef5c53-89a1-43b2-baa3-d5793cfeedad'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:19.920273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] The token cache is being invalidate because project 6118c77181d04035b723c3e4f8547db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:39:19.920659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:19.922593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bef5c53-89a1-43b2-baa3-d5793cfeedad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:19.924466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1087/2193] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:39:19 2022] DELETE /identity/v3/projects/6118c77181d04035b723c3e4f8547db3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:21.511290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:21.514051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:21.527992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:21.535487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754797a5-34f3-4983-bbc5-a5f5fea5d015 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:21.634956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:21.634956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:21.634956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:21.634956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] PATH_INFO: `/v3/users/8f0fd0aca23e4b92b1346a22c89d85eb` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:21.635284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0fd0aca23e4b92b1346a22c89d85eb)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:21.635284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:21.696436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0fd0aca23e4b92b1346a22c89d85eb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:21.719124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0fd0aca23e4b92b1346a22c89d85eb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:21.720774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0fd0aca23e4b92b1346a22c89d85eb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:21.740337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0fd0aca23e4b92b1346a22c89d85eb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:21.759598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0fd0aca23e4b92b1346a22c89d85eb'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:21.769996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1107/2194] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:39:21 2022] DELETE /identity/v3/users/8f0fd0aca23e4b92b1346a22c89d85eb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:21.774408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:21.774960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:21.775068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:21.795652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:21.798802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:21.898435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1088/2195] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:21.909951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:21.911856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:22.016611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03e909-c6f1-49fe-a865-d2ad668a64a9 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:22.024303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd36788-f3d7-40c1-8d5e-1ce32762370c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:22.026211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36788-f3d7-40c1-8d5e-1ce32762370c service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:22.026633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36788-f3d7-40c1-8d5e-1ce32762370c service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:22.027075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36788-f3d7-40c1-8d5e-1ce32762370c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:22.050908 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd36788-f3d7-40c1-8d5e-1ce32762370c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:22.054042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd36788-f3d7-40c1-8d5e-1ce32762370c service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:22.088615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1108/2196] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:39:22.682608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:22.684550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:22.709590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2043de-eb4d-40d9-aaae-5318423366ba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:22.723524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:22.724449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:22.724899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:22.728865 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] PATH_INFO: `/v3/projects/9ddf91d159a84eb99c8fdcfb79d8074c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:22.739747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddf91d159a84eb99c8fdcfb79d8074c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:22.742067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:22.871197 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddf91d159a84eb99c8fdcfb79d8074c', 'request_id': 'req-d7e1b309-13bd-40d2-b507-7d05ccfdd073'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:22.880247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddf91d159a84eb99c8fdcfb79d8074c', 'request_id': 'req-d7e1b309-13bd-40d2-b507-7d05ccfdd073'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:22.886770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddf91d159a84eb99c8fdcfb79d8074c', 'request_id': 'req-d7e1b309-13bd-40d2-b507-7d05ccfdd073'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:22.916309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] The token cache is being invalidate because project 9ddf91d159a84eb99c8fdcfb79d8074c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:39:22.916603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:22.917269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7e1b309-13bd-40d2-b507-7d05ccfdd073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:22.919016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1089/2197] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:39:22 2022] DELETE /identity/v3/projects/9ddf91d159a84eb99c8fdcfb79d8074c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:27.487708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:27.488313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:27.488313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:27.515970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] MFA Rules not processed for user `ae2fc4f8451e4cfebeca4d8a3916a828`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:27.518468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:27.544113 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:27.619248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1109/2198] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:32.913021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:33.254623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cfb4c-5308-43ee-8dcb-43fb798fe124 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:33.255625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cfb4c-5308-43ee-8dcb-43fb798fe124 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:33.256813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cfb4c-5308-43ee-8dcb-43fb798fe124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:33.284865 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-279cfb4c-5308-43ee-8dcb-43fb798fe124 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:33.288438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-279cfb4c-5308-43ee-8dcb-43fb798fe124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:33.377333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:33.378953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:33.388566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1090/2199] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:39:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:33.533954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa07a-7fc9-4a90-9f42-811b24f7338e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:33.540577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f608b6-e83a-4f8d-b248-b4ccd15c27de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:33.541660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f608b6-e83a-4f8d-b248-b4ccd15c27de service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:33.542108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f608b6-e83a-4f8d-b248-b4ccd15c27de service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:33.542732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f608b6-e83a-4f8d-b248-b4ccd15c27de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:33.554502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f608b6-e83a-4f8d-b248-b4ccd15c27de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:33.556776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f608b6-e83a-4f8d-b248-b4ccd15c27de service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:33.574268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1110/2200] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:39:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 18:39:34.533170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e69ee-3990-40d7-a774-b35ab9a208e0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:34.533686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e69ee-3990-40d7-a774-b35ab9a208e0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:34.533792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e69ee-3990-40d7-a774-b35ab9a208e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:34.557322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0e7e69ee-3990-40d7-a774-b35ab9a208e0 None None] MFA Rules not processed for user `e1231b9864444ae2a1eaf1099acfc709`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:34.559520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0e7e69ee-3990-40d7-a774-b35ab9a208e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:34.631239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1091/2201] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:35.330210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:35.331247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:35.331764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:35.359300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:35.364683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:35.374628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1111/2202] 10.222.0.20 () {58 vars in 967 bytes} [Sun Jul 31 18:39:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:35.389751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e69ee-3990-40d7-a774-b35ab9a208e0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:35.409115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e69ee-3990-40d7-a774-b35ab9a208e0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:35.415835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:35.416683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:35.417669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:35.418123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:35.436752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:35.439031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:35.458720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1092/2203] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:39:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:39:38.289007 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:38.289551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:38.399440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa341-29ae-4672-a4de-251018d490ce None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:38.406815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:38.407724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:38.408448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:38.408898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] PATH_INFO: `/v3/users/3e1c8b1e8375478888a9a7358bad9bae` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:38.410363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1c8b1e8375478888a9a7358bad9bae)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:38.416044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:38.529384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1c8b1e8375478888a9a7358bad9bae'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:38.539225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:38.547614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1c8b1e8375478888a9a7358bad9bae'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:38.553455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1c8b1e8375478888a9a7358bad9bae'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:38.569612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1c8b1e8375478888a9a7358bad9bae'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:38.594238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a2f4b3ce-1b07-4935-984a-7bd28d05da22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1c8b1e8375478888a9a7358bad9bae'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:38.604120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1112/2204] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:39:38 2022] DELETE /identity/v3/users/3e1c8b1e8375478888a9a7358bad9bae => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:39.005053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:39.035713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2194d1-9aff-4bdd-9ab5-98504c8f821f service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:39.192817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:39.194017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:39.194669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:39.195196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] PATH_INFO: `/v3/projects/1cb0c75f07074dfdb118d5120ffc128c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:39.200963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb0c75f07074dfdb118d5120ffc128c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:39.207086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:39.306404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:39.331714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb0c75f07074dfdb118d5120ffc128c', 'request_id': 'req-e6dccf28-abd2-445b-a98b-5e292d478ea0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:39.343243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb0c75f07074dfdb118d5120ffc128c', 'request_id': 'req-e6dccf28-abd2-445b-a98b-5e292d478ea0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:39.351692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb0c75f07074dfdb118d5120ffc128c', 'request_id': 'req-e6dccf28-abd2-445b-a98b-5e292d478ea0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:39.380218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] The token cache is being invalidate because project 1cb0c75f07074dfdb118d5120ffc128c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:39:39.380958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:39.381712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6dccf28-abd2-445b-a98b-5e292d478ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:39:39.387319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1093/2205] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:39:39 2022] DELETE /identity/v3/projects/1cb0c75f07074dfdb118d5120ffc128c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:39.388944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8435-c192-412a-86e3-118d67de9ee1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:39.389706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8435-c192-412a-86e3-118d67de9ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:39.389706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8435-c192-412a-86e3-118d67de9ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:39.437477 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f1df8435-c192-412a-86e3-118d67de9ee1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:39.440939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f1df8435-c192-412a-86e3-118d67de9ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:39.587734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1113/2206] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:39.596643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173ad92-0491-4798-859f-93d6e875a419 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:39.597031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173ad92-0491-4798-859f-93d6e875a419 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:39.597307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173ad92-0491-4798-859f-93d6e875a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:39.629587 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d173ad92-0491-4798-859f-93d6e875a419 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:39.631159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d173ad92-0491-4798-859f-93d6e875a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:39.640903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1094/2207] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:39:39.645245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8435-c192-412a-86e3-118d67de9ee1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:39.656894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8435-c192-412a-86e3-118d67de9ee1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:39.666572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:39.667524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:39.667966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:39.668608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:39.669862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:39:39.671539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:39.674422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:39.695404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1114/2208] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:39:39.697675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173ad92-0491-4798-859f-93d6e875a419 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:39.718191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173ad92-0491-4798-859f-93d6e875a419 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:39.724130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:39.724903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:39.725286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:39.725659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:39.726421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:39.730382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:39.789015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1095/2209] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:39:39 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:39:39.790302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:39.802729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd0217-8a1d-40fb-832e-5cae3f6aeae7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:39.900686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:39.901345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:39.901743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:39.901877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:39.902565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:39.904572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:39.952532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1115/2210] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:39:39 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:39:39.953547 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:39.968952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2350c84-6ce9-422d-8269-72368dc30b7d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:39.975237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:39.976087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:39.976470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:39.976837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:39.979022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:39.981663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:40.008969 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:40.020268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1096/2211] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:39:40.023074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7d89-945f-498b-a4b6-fcaba3a70055 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:40.031019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d3ba6-add2-43bf-8398-8859b9ecd5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:40.031780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d3ba6-add2-43bf-8398-8859b9ecd5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:40.032218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d3ba6-add2-43bf-8398-8859b9ecd5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:40.032589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d3ba6-add2-43bf-8398-8859b9ecd5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:40.033642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d3ba6-add2-43bf-8398-8859b9ecd5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:40.035390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d3ba6-add2-43bf-8398-8859b9ecd5a4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:40.060282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1116/2212] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:39:40.064665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:40.082271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc030f7-a655-49a8-9464-1185497c7d01 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:40.088860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:40.089778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:40.090081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:40.093092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] PATH_INFO: `/v3/projects/1c33d37b1fe0425592fc3c6c531a1a74/users/86a872fe01c2465ea6cca3822cf79686/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:40.113615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c33d37b1fe0425592fc3c6c531a1a74, user_id=86a872fe01c2465ea6cca3822cf79686, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:40.118582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:40.148220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1097/2213] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:39:40 2022] PUT /identity/v3/projects/1c33d37b1fe0425592fc3c6c531a1a74/users/86a872fe01c2465ea6cca3822cf79686/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:39:40.148917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6949-84a3-4940-ace1-c0d8932b3428 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:40.149578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6949-84a3-4940-ace1-c0d8932b3428 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:40.149578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6949-84a3-4940-ace1-c0d8932b3428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:40.188376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-215a6949-84a3-4940-ace1-c0d8932b3428 None None] MFA Rules not processed for user `86a872fe01c2465ea6cca3822cf79686`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:40.189631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-215a6949-84a3-4940-ace1-c0d8932b3428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:40.221514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:40.272887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1117/2214] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:40.288135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:40.291873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:40.517265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb386b21-45e2-4d79-9c01-cdaa32e582c6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:40.523366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d61247-4e5d-44b0-9193-903bb62f46f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:40.524641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d61247-4e5d-44b0-9193-903bb62f46f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:40.525366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d61247-4e5d-44b0-9193-903bb62f46f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:40.525366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d61247-4e5d-44b0-9193-903bb62f46f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:40.566191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d61247-4e5d-44b0-9193-903bb62f46f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:40.568104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d61247-4e5d-44b0-9193-903bb62f46f8 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:40.580390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1098/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:39:42.187043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48699b11-6bce-4a75-9e15-d0836f699bb4 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:42.187564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48699b11-6bce-4a75-9e15-d0836f699bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:42.187746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48699b11-6bce-4a75-9e15-d0836f699bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:42.214568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-48699b11-6bce-4a75-9e15-d0836f699bb4 None None] MFA Rules not processed for user `86a872fe01c2465ea6cca3822cf79686`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:42.216057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-48699b11-6bce-4a75-9e15-d0836f699bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:42.235443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1118/2216] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:39:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:50.574762 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:52.206248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=18 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:52.527523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bccf2-1f6f-4c17-a9e6-7ab76791571e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:52.528082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bccf2-1f6f-4c17-a9e6-7ab76791571e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:52.528082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bccf2-1f6f-4c17-a9e6-7ab76791571e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:52.530071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1099/2217] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:39:52.536088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0855-2654-48a4-93f2-f1a294341530 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:52.536401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0855-2654-48a4-93f2-f1a294341530 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:52.537211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0855-2654-48a4-93f2-f1a294341530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:52.556666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c8be0855-2654-48a4-93f2-f1a294341530 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:52.557892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c8be0855-2654-48a4-93f2-f1a294341530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:52.636873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1119/2218] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:39:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:52.648988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bccf2-1f6f-4c17-a9e6-7ab76791571e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:52.650824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b8bccf2-1f6f-4c17-a9e6-7ab76791571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:52.714885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bccf2-1f6f-4c17-a9e6-7ab76791571e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:52.719225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079793d6-d60c-4166-8a2c-dcc4865e5702 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:52.719913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079793d6-d60c-4166-8a2c-dcc4865e5702 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:52.720195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079793d6-d60c-4166-8a2c-dcc4865e5702 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:52.720472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079793d6-d60c-4166-8a2c-dcc4865e5702 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:52.731612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079793d6-d60c-4166-8a2c-dcc4865e5702 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:52.733137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079793d6-d60c-4166-8a2c-dcc4865e5702 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:52.744692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1100/2219] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:39:52.818325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f5c72-ae01-44cf-a0b7-16702ae76f01 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:52.818615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f5c72-ae01-44cf-a0b7-16702ae76f01 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:52.818897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f5c72-ae01-44cf-a0b7-16702ae76f01 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:52.820322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1120/2220] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:39:52.825255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf3f1-8cd7-4929-96dd-f27b3b91499b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:52.825539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf3f1-8cd7-4929-96dd-f27b3b91499b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:52.825813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf3f1-8cd7-4929-96dd-f27b3b91499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:52.847007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b6daf3f1-8cd7-4929-96dd-f27b3b91499b None None] MFA Rules not processed for user `235416b3ebfc42f48be079760f271fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:52.848668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b6daf3f1-8cd7-4929-96dd-f27b3b91499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:52.903705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1101/2221] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:39:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:52.915622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f5c72-ae01-44cf-a0b7-16702ae76f01 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:52.917416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b18f5c72-ae01-44cf-a0b7-16702ae76f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:52.931799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f5c72-ae01-44cf-a0b7-16702ae76f01 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:52.936089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa77a-4a9e-4fdf-9e68-60a112902f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:52.936795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa77a-4a9e-4fdf-9e68-60a112902f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:52.937145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa77a-4a9e-4fdf-9e68-60a112902f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:52.937485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa77a-4a9e-4fdf-9e68-60a112902f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:52.945563 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa77a-4a9e-4fdf-9e68-60a112902f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:52.947124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa77a-4a9e-4fdf-9e68-60a112902f96 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:52.956073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1121/2222] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:39:53.040758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91502-39d4-4275-9798-36d624e75049 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:53.041604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91502-39d4-4275-9798-36d624e75049 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:53.042025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91502-39d4-4275-9798-36d624e75049 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:53.043473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1102/2223] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:39:53.049806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8552a0-e532-4e4c-a91a-918dfac8b926 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:53.050111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8552a0-e532-4e4c-a91a-918dfac8b926 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:53.050392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8552a0-e532-4e4c-a91a-918dfac8b926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:53.071118 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1f8552a0-e532-4e4c-a91a-918dfac8b926 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:53.072334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1f8552a0-e532-4e4c-a91a-918dfac8b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:53.082553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1122/2224] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:39:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:39:53.093470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91502-39d4-4275-9798-36d624e75049 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:53.095259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15f91502-39d4-4275-9798-36d624e75049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:53.109889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91502-39d4-4275-9798-36d624e75049 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:53.113518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:53.114134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:53.114412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:53.114681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:53.126824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:53.128433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:53.141149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1103/2225] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:39:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:39:55.436503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe80c09-354f-494c-a45d-875b95e47c94 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:55.436960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe80c09-354f-494c-a45d-875b95e47c94 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:55.437141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe80c09-354f-494c-a45d-875b95e47c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:55.456132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-dbe80c09-354f-494c-a45d-875b95e47c94 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:39:55.457335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dbe80c09-354f-494c-a45d-875b95e47c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:55.515767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1123/2226] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:39:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:39:55.527973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:39:55.530236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:39:55.602446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af18f3-f91e-4e1c-afb9-1ef31bd9de0c service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:39:55.608678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:39:55.609016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:39:55.609300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:39:55.609563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:39:55.618064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:39:55.619723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:39:55.628269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1104/2227] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:40:05.509132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=65 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:05.624786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:14.851196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b139-ff05-44d3-8a1c-5c54597a6b94 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:14.851706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b139-ff05-44d3-8a1c-5c54597a6b94 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:14.851801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b139-ff05-44d3-8a1c-5c54597a6b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:14.870731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6982b139-ff05-44d3-8a1c-5c54597a6b94 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:14.871949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6982b139-ff05-44d3-8a1c-5c54597a6b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:14.879286 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1124/2228] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:40:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:14.891577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:14.902265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18777-21c4-4b49-b835-e8e1a97d6e6e service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:14.908337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:14.908943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:14.909225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:14.909502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:14.917406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:14.919016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:14.927265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1105/2229] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:40:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:40:15.425443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d920-57b3-43c2-a420-9b80b4b8adef None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:15.425736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d920-57b3-43c2-a420-9b80b4b8adef None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:15.426013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d920-57b3-43c2-a420-9b80b4b8adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:15.445035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9af3d920-57b3-43c2-a420-9b80b4b8adef None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:15.446165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9af3d920-57b3-43c2-a420-9b80b4b8adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:15.453928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1125/2230] 10.222.0.20 () {58 vars in 967 bytes} [Sun Jul 31 18:40:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:15.465857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:15.476986 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ee81-7f64-4804-af25-6b6a953d51a7 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:15.481969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:15.482651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:15.483131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:15.483414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:15.491358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:15.492937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:15.501173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1106/2231] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:40:15.723666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068907-2563-4579-9d27-0795d55534c2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:15.723953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068907-2563-4579-9d27-0795d55534c2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:15.724232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068907-2563-4579-9d27-0795d55534c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:15.743024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-82068907-2563-4579-9d27-0795d55534c2 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:15.744235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-82068907-2563-4579-9d27-0795d55534c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:15.751769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1126/2232] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:40:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:15.763536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:15.774743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574aa12-521a-4219-a3cf-41de1d7e87d0 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:15.780737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:15.781341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:15.781621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:15.781892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:15.790047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:15.791673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:15.800886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1107/2233] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:40:15.845653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59c9a-d0fe-42d9-8a9b-06f6db72a699 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:15.846013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59c9a-d0fe-42d9-8a9b-06f6db72a699 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:15.846423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59c9a-d0fe-42d9-8a9b-06f6db72a699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:15.868312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-95b59c9a-d0fe-42d9-8a9b-06f6db72a699 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:15.869511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-95b59c9a-d0fe-42d9-8a9b-06f6db72a699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:15.876721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1127/2234] 10.222.0.20 () {58 vars in 967 bytes} [Sun Jul 31 18:40:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:15.890526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:15.901096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca864-ac33-4aff-b78f-7359fe7e89f1 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:15.909589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:15.910204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:15.910479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:15.910752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:15.919450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:15.921826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:15.933658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1108/2235] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:40:16.135625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b7a3-9113-4bca-a313-13fbe99790a7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:16.135990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b7a3-9113-4bca-a313-13fbe99790a7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:16.136354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b7a3-9113-4bca-a313-13fbe99790a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:16.157586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-89c1b7a3-9113-4bca-a313-13fbe99790a7 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:16.159030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-89c1b7a3-9113-4bca-a313-13fbe99790a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:16.167077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1128/2236] 10.222.0.20 () {58 vars in 967 bytes} [Sun Jul 31 18:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:16.182879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:16.194958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9043-25d2-4874-a96f-4095fa73eeac service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:16.199984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8693-15a0-4979-be59-be053722ddaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:16.200733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8693-15a0-4979-be59-be053722ddaa service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:16.201059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8693-15a0-4979-be59-be053722ddaa service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:16.202223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8693-15a0-4979-be59-be053722ddaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:16.212190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd8693-15a0-4979-be59-be053722ddaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:16.214117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd8693-15a0-4979-be59-be053722ddaa service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:16.223631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1109/2237] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 18:40:18.322458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b7a3-9113-4bca-a313-13fbe99790a7 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:18.385759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b7a3-9113-4bca-a313-13fbe99790a7 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:18.390390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:18.391076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:18.391353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:18.391629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] PATH_INFO: `/v3/users/86a872fe01c2465ea6cca3822cf79686` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:18.392828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a872fe01c2465ea6cca3822cf79686)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:18.395059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:18.441589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a872fe01c2465ea6cca3822cf79686'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.448440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a872fe01c2465ea6cca3822cf79686'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.449107 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a872fe01c2465ea6cca3822cf79686'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.456017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a872fe01c2465ea6cca3822cf79686'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.467880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a872fe01c2465ea6cca3822cf79686'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.473689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1129/2238] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:40:18 2022] DELETE /identity/v3/users/86a872fe01c2465ea6cca3822cf79686 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:40:18.478220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:18.478670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:18.478797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:18.497752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:18.499541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:18.556459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1110/2239] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:18.567013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:18.568434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:18.620238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:18.627884 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18951a-aa29-40c2-9587-c7e7e2c5ec7d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:18.631894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb21e65-1cd7-40c4-b050-4bd34fc9ca2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:18.632539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb21e65-1cd7-40c4-b050-4bd34fc9ca2a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:18.632820 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb21e65-1cd7-40c4-b050-4bd34fc9ca2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:18.633097 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb21e65-1cd7-40c4-b050-4bd34fc9ca2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:18.642268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb21e65-1cd7-40c4-b050-4bd34fc9ca2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:18.644008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb21e65-1cd7-40c4-b050-4bd34fc9ca2a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:18.653443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1130/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:40:18.820768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:18.822374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:18.834888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef1c1-23bc-4dd3-9fb6-f95e748bec38 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:18.840127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:18.840776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:18.841065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:18.841325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] PATH_INFO: `/v3/projects/1c33d37b1fe0425592fc3c6c531a1a74` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:18.843311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c33d37b1fe0425592fc3c6c531a1a74)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:18.845297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:18.893908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c33d37b1fe0425592fc3c6c531a1a74', 'request_id': 'req-151370a9-01f9-4055-b509-92b2a99635ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.899947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c33d37b1fe0425592fc3c6c531a1a74', 'request_id': 'req-151370a9-01f9-4055-b509-92b2a99635ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.905578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c33d37b1fe0425592fc3c6c531a1a74', 'request_id': 'req-151370a9-01f9-4055-b509-92b2a99635ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.917397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] The token cache is being invalidate because project 1c33d37b1fe0425592fc3c6c531a1a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:40:18.917684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.918301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-151370a9-01f9-4055-b509-92b2a99635ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:18.920193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1111/2241] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:40:18 2022] DELETE /identity/v3/projects/1c33d37b1fe0425592fc3c6c531a1a74 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:40:18.924879 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade3e2-6e68-420b-8509-fa95f37e1a70 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:18.925161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade3e2-6e68-420b-8509-fa95f37e1a70 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:18.925432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade3e2-6e68-420b-8509-fa95f37e1a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:18.945768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f9ade3e2-6e68-420b-8509-fa95f37e1a70 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:18.946995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f9ade3e2-6e68-420b-8509-fa95f37e1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:19.004509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1131/2242] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:19.070614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646c489-c14c-4cdb-921c-7cf9e264a984 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.070878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646c489-c14c-4cdb-921c-7cf9e264a984 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.071193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646c489-c14c-4cdb-921c-7cf9e264a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.090785 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4646c489-c14c-4cdb-921c-7cf9e264a984 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:19.092058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4646c489-c14c-4cdb-921c-7cf9e264a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:19.100050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1112/2243] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:19.104379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ade3e2-6e68-420b-8509-fa95f37e1a70 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:19.114743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ade3e2-6e68-420b-8509-fa95f37e1a70 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:19.119249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:19.119850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.120123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.120389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.121068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:40:19.121387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:19.123824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:19.135048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1132/2244] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:40:19.139712 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646c489-c14c-4cdb-921c-7cf9e264a984 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:19.149225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646c489-c14c-4cdb-921c-7cf9e264a984 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:19.153876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:19.154485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.154765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.155066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.155734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:19.157666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:19.166975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:19.186017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1113/2245] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:40:19 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:40:19.190144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:19.200112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752fd08-5175-46b8-9707-8f06512ed64b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:19.257320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:19.257928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.258202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.258470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.259160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:19.261067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:19.281983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1133/2246] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:40:19 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:40:19.286166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:19.296961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0eb4-cdcf-49ab-949c-f9b02aedb76e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:19.301564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:19.302177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.302462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.302737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.303469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:19.305071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:19.315760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1114/2247] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:40:19.319604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:19.329862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1538-eefe-4508-b950-c61caae81c9f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:19.334406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be83fc-f41a-4c52-a44c-f52aa110dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:19.335045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be83fc-f41a-4c52-a44c-f52aa110dcaf admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.335323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be83fc-f41a-4c52-a44c-f52aa110dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.335592 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be83fc-f41a-4c52-a44c-f52aa110dcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.336272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be83fc-f41a-4c52-a44c-f52aa110dcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:19.337843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be83fc-f41a-4c52-a44c-f52aa110dcaf admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:19.348360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1134/2248] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:40:19.352421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:19.363268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5236-7d56-4814-8600-fdd624ce3803 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:19.367938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:19.368596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.368877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.369273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] PATH_INFO: `/v3/projects/d3b73aef713c45f2bdab6263fee19983/users/52c534a2294b42ff832c2ee31ef73674/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.384139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b73aef713c45f2bdab6263fee19983, user_id=52c534a2294b42ff832c2ee31ef73674, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:19.386786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:19.400241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1115/2249] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:40:19 2022] PUT /identity/v3/projects/d3b73aef713c45f2bdab6263fee19983/users/52c534a2294b42ff832c2ee31ef73674/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:40:19.410463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.410752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.411067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.441971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] MFA Rules not processed for user `52c534a2294b42ff832c2ee31ef73674`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:19.443341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:19.486894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:19.508404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1135/2250] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:40:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:19.519556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:19.521374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:19.577297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8ce6-4c65-4df0-9707-9677db319524 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:19.581013 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:19.581573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:19.581855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:19.582131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:19.590439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:19.592685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:19.601460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1116/2251] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:40:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:40:23.010442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:23.011911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:23.079617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65244cd3-3796-481d-b8eb-7c0a8faeba8b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:23.084562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ad6ba-672b-4504-a817-03858cf757a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:23.085199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ad6ba-672b-4504-a817-03858cf757a5 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:23.085479 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ad6ba-672b-4504-a817-03858cf757a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:23.085752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ad6ba-672b-4504-a817-03858cf757a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:23.087532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-503ad6ba-672b-4504-a817-03858cf757a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:23.099598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ad6ba-672b-4504-a817-03858cf757a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:23.101178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ad6ba-672b-4504-a817-03858cf757a5 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:23.110897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1136/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:40:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:40:29.597492 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:29.638949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:29.700838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3314-eef5-4f39-96b4-296d5bd8f65e service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:29.705489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:29.706146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:29.706429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:29.706702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] PATH_INFO: `/v3/users/52c534a2294b42ff832c2ee31ef73674` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:29.707893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c534a2294b42ff832c2ee31ef73674)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:29.709846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:29.759654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c534a2294b42ff832c2ee31ef73674'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:29.760309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c534a2294b42ff832c2ee31ef73674'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:29.767321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c534a2294b42ff832c2ee31ef73674'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:29.774302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c534a2294b42ff832c2ee31ef73674'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:29.774948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c534a2294b42ff832c2ee31ef73674'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:29.792052 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1117/2253] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:40:29 2022] DELETE /identity/v3/users/52c534a2294b42ff832c2ee31ef73674 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:40:29.797173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:29.797654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:29.797751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:29.817815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:29.819031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:29.876302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1137/2254] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:29.885764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:29.887230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:29.947509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec959-ce4c-4606-9b59-b2c717d05012 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:29.951193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a87aac-7214-422c-be0b-3592a9d27b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:29.951757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87aac-7214-422c-be0b-3592a9d27b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:29.952682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87aac-7214-422c-be0b-3592a9d27b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:29.952956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87aac-7214-422c-be0b-3592a9d27b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:29.961878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a87aac-7214-422c-be0b-3592a9d27b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:29.963354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a87aac-7214-422c-be0b-3592a9d27b05 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:29.973286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1118/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:40:30.238425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:40:30.240080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:30.252937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52720e-0cf6-438d-bd6d-82960f2f832c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:40:30.258566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:40:30.259319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:30.259638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:30.259849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] PATH_INFO: `/v3/projects/d3b73aef713c45f2bdab6263fee19983` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:30.261012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b73aef713c45f2bdab6263fee19983)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:40:30.263853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:40:30.313321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b73aef713c45f2bdab6263fee19983', 'request_id': 'req-c9ece8db-688c-4295-9618-6837cca006a2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:30.318607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b73aef713c45f2bdab6263fee19983', 'request_id': 'req-c9ece8db-688c-4295-9618-6837cca006a2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:30.326000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b73aef713c45f2bdab6263fee19983', 'request_id': 'req-c9ece8db-688c-4295-9618-6837cca006a2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:30.332992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:30.338589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] The token cache is being invalidate because project d3b73aef713c45f2bdab6263fee19983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:40:30.338917 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:30.339821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c9ece8db-688c-4295-9618-6837cca006a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:40:30.341846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1138/2256] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:40:30 2022] DELETE /identity/v3/projects/d3b73aef713c45f2bdab6263fee19983 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:40:39.968961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:40.347032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:44.470822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6ca3-3efd-4bcb-a5e0-4f8055bdcc6c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:44.471404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6ca3-3efd-4bcb-a5e0-4f8055bdcc6c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:44.471404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6ca3-3efd-4bcb-a5e0-4f8055bdcc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:44.491579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-44ba6ca3-3efd-4bcb-a5e0-4f8055bdcc6c None None] MFA Rules not processed for user `ae2fc4f8451e4cfebeca4d8a3916a828`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:44.492795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44ba6ca3-3efd-4bcb-a5e0-4f8055bdcc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:44.546786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1119/2257] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:40:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:40:54.539996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=25 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:59.447609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bd5-0d55-4f59-ab88-2ddac27caebe None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:40:59.448087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bd5-0d55-4f59-ab88-2ddac27caebe None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:40:59.448182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bd5-0d55-4f59-ab88-2ddac27caebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:40:59.468006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-05450bd5-0d55-4f59-ab88-2ddac27caebe None None] MFA Rules not processed for user `e1231b9864444ae2a1eaf1099acfc709`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:40:59.469403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-05450bd5-0d55-4f59-ab88-2ddac27caebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:40:59.523222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1139/2258] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:40:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:41:06.973390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914119-ab3d-429e-b07e-2b805ce94af9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:41:06.973917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914119-ab3d-429e-b07e-2b805ce94af9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:41:06.973917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914119-ab3d-429e-b07e-2b805ce94af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:41:06.993899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-09914119-ab3d-429e-b07e-2b805ce94af9 None None] MFA Rules not processed for user `d373d8477581449ca1ac0b462de7ba59`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:41:06.995049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-09914119-ab3d-429e-b07e-2b805ce94af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:41:07.047756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1120/2259] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:41:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:41:09.516235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=25 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:17.041235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=25 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:45.535319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c240-cd8e-4369-b29d-3082f458d05d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:41:45.535859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c240-cd8e-4369-b29d-3082f458d05d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:41:45.535974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c240-cd8e-4369-b29d-3082f458d05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:41:45.558832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-86b5c240-cd8e-4369-b29d-3082f458d05d None None] MFA Rules not processed for user `ae2fc4f8451e4cfebeca4d8a3916a828`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:41:45.558832 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-86b5c240-cd8e-4369-b29d-3082f458d05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:41:45.564847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1140/2260] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:41:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:41:54.392870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6af2f-1a1c-463f-a106-7b08c8c25f07 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:41:54.393379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6af2f-1a1c-463f-a106-7b08c8c25f07 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:41:54.393464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6af2f-1a1c-463f-a106-7b08c8c25f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:41:54.413761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9de6af2f-1a1c-463f-a106-7b08c8c25f07 None None] MFA Rules not processed for user `3f9cc8143db243deae4184622a4a2a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:41:54.415292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9de6af2f-1a1c-463f-a106-7b08c8c25f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:41:54.482076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1121/2261] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:41:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:41:55.550670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:04.471848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=25 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:14.088358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aab0b-d7fe-4e7f-acee-91bfd29252a8 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.089194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aab0b-d7fe-4e7f-acee-91bfd29252a8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.089194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aab0b-d7fe-4e7f-acee-91bfd29252a8 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.090573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1141/2262] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:42:14.130516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.131065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.131159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.153160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] MFA Rules not processed for user `4b07b5471c93462e90c45a195fdc376d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:14.155202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:14.190857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aab0b-d7fe-4e7f-acee-91bfd29252a8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:14.192604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f56aab0b-d7fe-4e7f-acee-91bfd29252a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:14.224291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1122/2263] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:42:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:14.241797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:14.243956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:14.259182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0b42b-b21c-4fc1-b4f1-0ba4bfa83b9f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:14.265265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:14.265421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aab0b-d7fe-4e7f-acee-91bfd29252a8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:14.265888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.266168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.266440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.270298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:14.270982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.271271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.271546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] PATH_INFO: `/v3/users/e1231b9864444ae2a1eaf1099acfc709` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.272736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1231b9864444ae2a1eaf1099acfc709)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:14.274700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:14.275189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:14.277050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:14.286738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1123/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:14.323742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1231b9864444ae2a1eaf1099acfc709'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.330449 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1231b9864444ae2a1eaf1099acfc709'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.331147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1231b9864444ae2a1eaf1099acfc709'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.339247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1231b9864444ae2a1eaf1099acfc709'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.350748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b326dbb7-d01b-453e-894a-5b5a77e3e514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1231b9864444ae2a1eaf1099acfc709'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.357568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1142/2265] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:14 2022] DELETE /identity/v3/users/e1231b9864444ae2a1eaf1099acfc709 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:42:14.533573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:14.545313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9e44a-7561-490c-8bb7-8da02a7f6936 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:14.603114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:14.603688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.604102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.604372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] PATH_INFO: `/v3/projects/90a0ac38df924665a9cdef3191bf3456` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.605522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a0ac38df924665a9cdef3191bf3456)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:14.607462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:14.653133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a0ac38df924665a9cdef3191bf3456', 'request_id': 'req-631a41db-1626-47af-9ad1-66500d16e813'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.659323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a0ac38df924665a9cdef3191bf3456', 'request_id': 'req-631a41db-1626-47af-9ad1-66500d16e813'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.664704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a0ac38df924665a9cdef3191bf3456', 'request_id': 'req-631a41db-1626-47af-9ad1-66500d16e813'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.676543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] The token cache is being invalidate because project 90a0ac38df924665a9cdef3191bf3456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:14.676827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.677444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-631a41db-1626-47af-9ad1-66500d16e813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:14.678953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1124/2266] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:14 2022] DELETE /identity/v3/projects/90a0ac38df924665a9cdef3191bf3456 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:14.684662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597e85-1f88-44a7-9a94-974ab62a8861 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.684950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597e85-1f88-44a7-9a94-974ab62a8861 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.685250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597e85-1f88-44a7-9a94-974ab62a8861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.705746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9b597e85-1f88-44a7-9a94-974ab62a8861 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:14.706960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9b597e85-1f88-44a7-9a94-974ab62a8861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:14.766464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1143/2267] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:42:14.774357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d01f29-22a7-4e14-b06b-7df1bc2d3679 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.774644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d01f29-22a7-4e14-b06b-7df1bc2d3679 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.774920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d01f29-22a7-4e14-b06b-7df1bc2d3679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.795326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c4d01f29-22a7-4e14-b06b-7df1bc2d3679 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:14.796523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c4d01f29-22a7-4e14-b06b-7df1bc2d3679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:14.804310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1125/2268] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:14.809263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597e85-1f88-44a7-9a94-974ab62a8861 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:14.818966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597e85-1f88-44a7-9a94-974ab62a8861 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:14.823825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:14.824437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.824724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.824997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.825713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:42:14.826016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:14.827649 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:14.841478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1144/2269] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:42:14.845885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d01f29-22a7-4e14-b06b-7df1bc2d3679 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:14.855733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d01f29-22a7-4e14-b06b-7df1bc2d3679 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:14.860320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:14.860927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.861204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.861473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.862132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:14.864074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:14.868480 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:14.893577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1126/2270] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:14 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:14.897768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:14.908291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d64a33-5ac3-462e-bbfc-7bfed9445266 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:14.911843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:14.968933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:14.969568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:14.969847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:14.970151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:14.970793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:14.972766 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:14.994081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1145/2271] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:14 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:14.998862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.009255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efd340-cc33-43b8-a1d5-2cb7d46b5360 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.014511 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.015156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.015437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.015707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.016403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.018254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.028422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1127/2272] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:15.032336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.042614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1801b1-3f29-4421-9c7f-d90a4b61d775 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.047177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1430aa-fd0d-4c3b-97d5-212bccf50d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.047775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1430aa-fd0d-4c3b-97d5-212bccf50d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.048050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1430aa-fd0d-4c3b-97d5-212bccf50d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.048322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1430aa-fd0d-4c3b-97d5-212bccf50d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.048999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1430aa-fd0d-4c3b-97d5-212bccf50d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.050580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1430aa-fd0d-4c3b-97d5-212bccf50d2b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.061558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1146/2273] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:15.065749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.075829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4ff5-3f18-476a-b8f1-24e5d2f8f108 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.080380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.081037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.081316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.081592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] PATH_INFO: `/v3/projects/55dddb43a16945a79b230460694e6656/users/f703582975e2441f90086dfc46b513a2/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.096192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=55dddb43a16945a79b230460694e6656, user_id=f703582975e2441f90086dfc46b513a2, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.098827 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.114638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1128/2274] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:15 2022] PUT /identity/v3/projects/55dddb43a16945a79b230460694e6656/users/f703582975e2441f90086dfc46b513a2/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:15.125657 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8f30-d6e3-4d87-bbe2-dc78945df5d8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.126170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8f30-d6e3-4d87-bbe2-dc78945df5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.126170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8f30-d6e3-4d87-bbe2-dc78945df5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.156354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-386d8f30-d6e3-4d87-bbe2-dc78945df5d8 None None] MFA Rules not processed for user `f703582975e2441f90086dfc46b513a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:15.157554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-386d8f30-d6e3-4d87-bbe2-dc78945df5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:15.225194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1147/2275] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:15.229844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.296401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb00bd-c08a-4944-98b3-661029e0c3ce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.301234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.301858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.302140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.302412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.303137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.305049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.332978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1129/2276] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:15 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:15.337004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8f30-d6e3-4d87-bbe2-dc78945df5d8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.348812 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8f30-d6e3-4d87-bbe2-dc78945df5d8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.406195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.406745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.407057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.407333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.407997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.409927 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.432355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1148/2277] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:15 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:15.435276 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.445865 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b707a8-c23b-4cdc-9e28-214bdbfbb79a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.451655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.452404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.452688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.452959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.453649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.455357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.466113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1130/2278] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:15.470359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.476700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:15.480870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32f5da-2905-455b-a72e-702735f402fc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.486391 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.487089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.487370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.487642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] PATH_INFO: `/v3/projects/1410a927574f43478284d02dd98a2468/users/e1b6249d209d4242b2f514fa3c213981/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.503041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1410a927574f43478284d02dd98a2468, user_id=e1b6249d209d4242b2f514fa3c213981, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.505728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.520023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1149/2279] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:15 2022] PUT /identity/v3/projects/1410a927574f43478284d02dd98a2468/users/e1b6249d209d4242b2f514fa3c213981/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:15.524110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.534297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db4216-86e2-4e0c-989b-aad43198f6f8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.592549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b156-f477-4b90-8b98-9faecb94f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.593176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b156-f477-4b90-8b98-9faecb94f07b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.593459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b156-f477-4b90-8b98-9faecb94f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.593738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b156-f477-4b90-8b98-9faecb94f07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.594428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6b156-f477-4b90-8b98-9faecb94f07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.596073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6b156-f477-4b90-8b98-9faecb94f07b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.605952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1131/2280] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:15.610320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.621375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa58110-c3e7-4c2d-9efe-205822569454 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.626124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.626788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.627112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.627423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] PATH_INFO: `/v3/projects/1410a927574f43478284d02dd98a2468/users/e1b6249d209d4242b2f514fa3c213981/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.629360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1410a927574f43478284d02dd98a2468, user_id=e1b6249d209d4242b2f514fa3c213981, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.632037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.643241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1150/2281] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:15 2022] PUT /identity/v3/projects/1410a927574f43478284d02dd98a2468/users/e1b6249d209d4242b2f514fa3c213981/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:15.654841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec5c72-27d4-456d-b5b4-e74393b1595f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.655164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec5c72-27d4-456d-b5b4-e74393b1595f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.655445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec5c72-27d4-456d-b5b4-e74393b1595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.683806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-caec5c72-27d4-456d-b5b4-e74393b1595f None None] MFA Rules not processed for user `e1b6249d209d4242b2f514fa3c213981`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:15.685019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-caec5c72-27d4-456d-b5b4-e74393b1595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:15.693028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:15.753923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1132/2282] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:15 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:15.765841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:15.767857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:15.824776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec05bb-4237-4bbe-97e8-6ca8d54abfc6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:15.828474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6bfc3-7283-4715-8e03-7a60dbe0bd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:15.829084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bfc3-7283-4715-8e03-7a60dbe0bd11 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:15.829362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bfc3-7283-4715-8e03-7a60dbe0bd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:15.829636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bfc3-7283-4715-8e03-7a60dbe0bd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:15.838548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6bfc3-7283-4715-8e03-7a60dbe0bd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:15.839995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6bfc3-7283-4715-8e03-7a60dbe0bd11 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:15.849242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1151/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:16.260857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec5c72-27d4-456d-b5b4-e74393b1595f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:16.320953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec5c72-27d4-456d-b5b4-e74393b1595f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:16.326258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:16.326896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:16.327212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:16.327490 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] PATH_INFO: `/v3/users/f703582975e2441f90086dfc46b513a2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:16.328652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f703582975e2441f90086dfc46b513a2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:16.330580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:16.378027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f703582975e2441f90086dfc46b513a2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.378680 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f703582975e2441f90086dfc46b513a2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.387365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f703582975e2441f90086dfc46b513a2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.394411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f703582975e2441f90086dfc46b513a2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.395073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f703582975e2441f90086dfc46b513a2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.411792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1133/2284] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:16 2022] DELETE /identity/v3/users/f703582975e2441f90086dfc46b513a2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:16.416354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:16.416850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:16.416850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:16.437645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:16.438856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:16.500713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1152/2285] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:16.510004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:16.511562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:16.542116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:16.573780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc6c0-8cf4-4ddb-9794-10a10630927a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:16.577462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:16.578080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:16.578363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:16.578638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:16.587754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:16.589201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:16.598590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1134/2286] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:16.878792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:16.880273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:16.892898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742cd07-88e1-498e-b5ab-55d479ce788e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:16.897510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:16.898156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:16.898435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:16.898709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] PATH_INFO: `/v3/projects/55dddb43a16945a79b230460694e6656` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:16.899913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55dddb43a16945a79b230460694e6656)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:16.902354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:16.950745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55dddb43a16945a79b230460694e6656', 'request_id': 'req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.957330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55dddb43a16945a79b230460694e6656', 'request_id': 'req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.965987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55dddb43a16945a79b230460694e6656', 'request_id': 'req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.967135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:16.980599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] The token cache is being invalidate because project 55dddb43a16945a79b230460694e6656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:16.980890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.981527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:16.983072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1153/2287] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:16 2022] DELETE /identity/v3/projects/55dddb43a16945a79b230460694e6656 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:42:16.987176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:16.997015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cacab-a9f7-4970-8439-7565eee3b19c service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.052947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.053581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.053864 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.054142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] PATH_INFO: `/v3/users/e1b6249d209d4242b2f514fa3c213981` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.055334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b6249d209d4242b2f514fa3c213981)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.057619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:17.104767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b6249d209d4242b2f514fa3c213981'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.105438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b6249d209d4242b2f514fa3c213981'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.112349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b6249d209d4242b2f514fa3c213981'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.119078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b6249d209d4242b2f514fa3c213981'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.119851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a73b60e5-5e27-494c-931f-5f05bd082193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b6249d209d4242b2f514fa3c213981'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.136406 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1135/2288] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:16 2022] DELETE /identity/v3/users/e1b6249d209d4242b2f514fa3c213981 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:17.414223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:17.415731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:17.429553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140fa9-4e85-45b4-b57a-8f65aeb145e2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.488993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.489561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.489837 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.490109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] PATH_INFO: `/v3/projects/1410a927574f43478284d02dd98a2468` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.491593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1410a927574f43478284d02dd98a2468)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.493254 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:17.540894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1410a927574f43478284d02dd98a2468', 'request_id': 'req-bb16469d-bacb-4d43-a942-06370e28ed20'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.547295 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1410a927574f43478284d02dd98a2468', 'request_id': 'req-bb16469d-bacb-4d43-a942-06370e28ed20'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.556183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1410a927574f43478284d02dd98a2468', 'request_id': 'req-bb16469d-bacb-4d43-a942-06370e28ed20'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.568934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] The token cache is being invalidate because project 1410a927574f43478284d02dd98a2468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:17.569208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.569835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bb16469d-bacb-4d43-a942-06370e28ed20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:17.571361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1154/2289] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:17 2022] DELETE /identity/v3/projects/1410a927574f43478284d02dd98a2468 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:17.577445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd046-a216-4c54-b9c7-7ceec5374fcb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.577890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd046-a216-4c54-b9c7-7ceec5374fcb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.577985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd046-a216-4c54-b9c7-7ceec5374fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.598286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8c3fd046-a216-4c54-b9c7-7ceec5374fcb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:17.599528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c3fd046-a216-4c54-b9c7-7ceec5374fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:17.641919 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:17.664157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1136/2290] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:17.672362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174beae-2684-4760-b6d1-0dbd138e6d21 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.672726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174beae-2684-4760-b6d1-0dbd138e6d21 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.673068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174beae-2684-4760-b6d1-0dbd138e6d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.695350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-8174beae-2684-4760-b6d1-0dbd138e6d21 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:17.696573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8174beae-2684-4760-b6d1-0dbd138e6d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:17.705686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1155/2291] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:17.709736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fd046-a216-4c54-b9c7-7ceec5374fcb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:17.719834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fd046-a216-4c54-b9c7-7ceec5374fcb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.724845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.725493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.725781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.726055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.726745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:42:17.727092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.728768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:17.740664 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1137/2292] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:42:17.745791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174beae-2684-4760-b6d1-0dbd138e6d21 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:17.755068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174beae-2684-4760-b6d1-0dbd138e6d21 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.759778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.761478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.761758 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.762030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.762686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.764625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:17.791867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1156/2293] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:17 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:17.796120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:17.805959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd986d6-f4ac-47bb-a1ac-6b909302a2fe admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.862344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.862988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.863274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.863546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.864218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.866146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:17.887755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1138/2294] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:17 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:17.891896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:17.902584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81b6a-9b91-42fa-91f7-0f25284626a1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.907175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.907780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.908056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.908325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.909006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.910627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:17.920390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1157/2295] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:17.924156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:17.934630 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b99eb-fe96-4592-92e3-9a447fd536e1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.939295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62959858-18ae-4a8b-99b6-fa7eb90a9abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.939895 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959858-18ae-4a8b-99b6-fa7eb90a9abd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.940172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959858-18ae-4a8b-99b6-fa7eb90a9abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.940445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959858-18ae-4a8b-99b6-fa7eb90a9abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.941134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62959858-18ae-4a8b-99b6-fa7eb90a9abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.942719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62959858-18ae-4a8b-99b6-fa7eb90a9abd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:17.955147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1139/2296] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:17.959308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:17.970031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da2afd-fe58-429d-b019-180a8839e611 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:17.974596 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:17.975298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:17.975576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:17.975847 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] PATH_INFO: `/v3/projects/8ee57bf814ca4cd7b6599b0ae8c5c83e/users/453c3012cd30441fa5ece19e4453af34/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:17.990217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee57bf814ca4cd7b6599b0ae8c5c83e, user_id=453c3012cd30441fa5ece19e4453af34, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:17.992960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.006241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1158/2297] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:17 2022] PUT /identity/v3/projects/8ee57bf814ca4cd7b6599b0ae8c5c83e/users/453c3012cd30441fa5ece19e4453af34/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:18.022336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe366f-1db9-426d-aae0-12c73cc511cb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.022622 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe366f-1db9-426d-aae0-12c73cc511cb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.022896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe366f-1db9-426d-aae0-12c73cc511cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.050127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-54fe366f-1db9-426d-aae0-12c73cc511cb None None] MFA Rules not processed for user `453c3012cd30441fa5ece19e4453af34`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:18.051343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-54fe366f-1db9-426d-aae0-12c73cc511cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:18.113930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1140/2298] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:18.118399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.139459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:18.180644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aaf92-0ae8-48c1-b318-0a322fe36f14 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.185813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.186429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.186704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.187001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.187666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.189558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.217982 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1159/2299] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:18 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:18.221357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe366f-1db9-426d-aae0-12c73cc511cb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.232403 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe366f-1db9-426d-aae0-12c73cc511cb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.273535 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:18.293607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.294220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.294497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.294769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.295451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.297366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.318265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1141/2300] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:18 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:18.322773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.333149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fb5e7-3be8-4fab-9072-38e6e12785cd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.337766 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.338919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.339239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.339510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.340198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.341790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.352159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1160/2301] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:18.356147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.365856 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299681-abdc-409a-aec0-c67eef6708d3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.370668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.371359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.371644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.371921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] PATH_INFO: `/v3/projects/1a94f0dca5ef429bb3da26bee0404df2/users/cde377c241da4be49906c0b0a784205e/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.386751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a94f0dca5ef429bb3da26bee0404df2, user_id=cde377c241da4be49906c0b0a784205e, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.389448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.402489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1142/2302] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:18 2022] PUT /identity/v3/projects/1a94f0dca5ef429bb3da26bee0404df2/users/cde377c241da4be49906c0b0a784205e/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:42:18.406350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.416208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4255b-24a4-4aea-ad3f-17524db29268 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.472630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5eeff-c2ef-409d-bb6c-449a04576574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.473305 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5eeff-c2ef-409d-bb6c-449a04576574 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.473791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5eeff-c2ef-409d-bb6c-449a04576574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.474066 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5eeff-c2ef-409d-bb6c-449a04576574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.474753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5eeff-c2ef-409d-bb6c-449a04576574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.476371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5eeff-c2ef-409d-bb6c-449a04576574 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.486546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1161/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:18.490741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.501509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf228a-9f43-4d9d-b6be-2a41f512af66 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.506073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.506727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.507046 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.507316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] PATH_INFO: `/v3/projects/1a94f0dca5ef429bb3da26bee0404df2/users/cde377c241da4be49906c0b0a784205e/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.509208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a94f0dca5ef429bb3da26bee0404df2, user_id=cde377c241da4be49906c0b0a784205e, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.512580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.522671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1143/2304] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:18 2022] PUT /identity/v3/projects/1a94f0dca5ef429bb3da26bee0404df2/users/cde377c241da4be49906c0b0a784205e/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:18.532902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4ee4-0804-4a3b-b01c-ca1b76968bad None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.533124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4ee4-0804-4a3b-b01c-ca1b76968bad None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.533393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4ee4-0804-4a3b-b01c-ca1b76968bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.560861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-181d4ee4-0804-4a3b-b01c-ca1b76968bad None None] MFA Rules not processed for user `cde377c241da4be49906c0b0a784205e`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:18.562051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-181d4ee4-0804-4a3b-b01c-ca1b76968bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:18.628752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1162/2305] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:18.640588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.642583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:18.701100 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790369b-5542-4ed0-9b94-bdfc05fb6793 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.704774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93481189-0a64-4785-9c71-4cce100d26ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.705388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481189-0a64-4785-9c71-4cce100d26ed service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.705672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481189-0a64-4785-9c71-4cce100d26ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.705943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481189-0a64-4785-9c71-4cce100d26ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.715780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93481189-0a64-4785-9c71-4cce100d26ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.717234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93481189-0a64-4785-9c71-4cce100d26ed service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.726906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1144/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:18.811339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d4ee4-0804-4a3b-b01c-ca1b76968bad None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:18.821333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d4ee4-0804-4a3b-b01c-ca1b76968bad None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:18.825669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:18.826299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:18.826579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:18.826855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:18.840031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:18.889573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:18.891046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:18.900337 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1163/2307] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:19.488581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7cb3-ce81-4461-a75a-1cbdc019188a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:19.488870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7cb3-ce81-4461-a75a-1cbdc019188a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:19.489149 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7cb3-ce81-4461-a75a-1cbdc019188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:19.509749 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ac9a7cb3-ce81-4461-a75a-1cbdc019188a None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:19.511901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ac9a7cb3-ce81-4461-a75a-1cbdc019188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:19.567607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1145/2308] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:42:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:19.616018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:19.617554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:19.693689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092935a-81c9-4c68-a5b0-6f86b7136e25 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:19.699562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348b5b7-5806-49de-89bf-7a06f241d7b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:19.700241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b5b7-5806-49de-89bf-7a06f241d7b0 service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:19.700524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b5b7-5806-49de-89bf-7a06f241d7b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:19.700945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b5b7-5806-49de-89bf-7a06f241d7b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:19.709269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348b5b7-5806-49de-89bf-7a06f241d7b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:19.710914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348b5b7-5806-49de-89bf-7a06f241d7b0 service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:19.719918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1164/2309] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:42:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:42:24.026049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a7cb3-ce81-4461-a75a-1cbdc019188a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:24.084005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:24.108889 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a7cb3-ce81-4461-a75a-1cbdc019188a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:24.114019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:24.114879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:24.115349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:24.115488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] PATH_INFO: `/v3/users/453c3012cd30441fa5ece19e4453af34` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:24.116597 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453c3012cd30441fa5ece19e4453af34)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:24.118542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:24.179538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453c3012cd30441fa5ece19e4453af34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:24.180164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453c3012cd30441fa5ece19e4453af34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:24.192595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453c3012cd30441fa5ece19e4453af34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:24.201395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453c3012cd30441fa5ece19e4453af34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:24.202084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453c3012cd30441fa5ece19e4453af34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:24.221443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1146/2310] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:24 2022] DELETE /identity/v3/users/453c3012cd30441fa5ece19e4453af34 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:24.225960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:24.226471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:24.226565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:24.254465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:24.255786 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:24.330533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1165/2311] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:24.343202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:24.344791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:24.408728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b789c-a24e-4716-b3a5-00a46d7c3360 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:24.413275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:24.413900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:24.414179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:24.414454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:24.430257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:24.430257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:24.446484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1147/2312] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:24.816588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:24.822513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:24.864050 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a007fc-c437-4910-b982-635b84a9eb34 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:24.872903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:24.873552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:24.873827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:24.874096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] PATH_INFO: `/v3/projects/8ee57bf814ca4cd7b6599b0ae8c5c83e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:24.875369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee57bf814ca4cd7b6599b0ae8c5c83e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:24.878071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:24.942030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:24.954138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee57bf814ca4cd7b6599b0ae8c5c83e', 'request_id': 'req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:24.960645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee57bf814ca4cd7b6599b0ae8c5c83e', 'request_id': 'req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:24.978904 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee57bf814ca4cd7b6599b0ae8c5c83e', 'request_id': 'req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.003272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] The token cache is being invalidate because project 8ee57bf814ca4cd7b6599b0ae8c5c83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:25.003272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.003272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.003272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1166/2313] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:24 2022] DELETE /identity/v3/projects/8ee57bf814ca4cd7b6599b0ae8c5c83e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:25.007539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:25.022616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5bc14-d933-4e10-b181-565b155154e7 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:25.087431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:25.088923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:25.088923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:25.088923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] PATH_INFO: `/v3/users/cde377c241da4be49906c0b0a784205e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:25.090062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde377c241da4be49906c0b0a784205e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:25.092018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:25.096867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:25.181940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde377c241da4be49906c0b0a784205e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.182660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde377c241da4be49906c0b0a784205e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.193641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde377c241da4be49906c0b0a784205e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.202326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde377c241da4be49906c0b0a784205e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.203093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb19a50-2e82-4d21-9b3f-f5677a37d1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde377c241da4be49906c0b0a784205e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.224248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1148/2314] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:25 2022] DELETE /identity/v3/users/cde377c241da4be49906c0b0a784205e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:25.618778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:25.621970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:25.660138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a65cad-dfe8-4b69-92b4-cedd6e00ee00 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:25.732544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:25.733122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:25.733400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:25.733669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] PATH_INFO: `/v3/projects/1a94f0dca5ef429bb3da26bee0404df2` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:25.734835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a94f0dca5ef429bb3da26bee0404df2)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:25.736793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:25.794767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a94f0dca5ef429bb3da26bee0404df2', 'request_id': 'req-27f061de-e52b-489e-97e3-42c90d366841'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.802693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a94f0dca5ef429bb3da26bee0404df2', 'request_id': 'req-27f061de-e52b-489e-97e3-42c90d366841'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.812056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a94f0dca5ef429bb3da26bee0404df2', 'request_id': 'req-27f061de-e52b-489e-97e3-42c90d366841'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.825258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] The token cache is being invalidate because project 1a94f0dca5ef429bb3da26bee0404df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:25.825533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.826242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-27f061de-e52b-489e-97e3-42c90d366841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:25.828032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1167/2315] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:25 2022] DELETE /identity/v3/projects/1a94f0dca5ef429bb3da26bee0404df2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:25.832777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db97ce-e6c9-4d1b-b3a1-fcc2ca05d85e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:25.833069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db97ce-e6c9-4d1b-b3a1-fcc2ca05d85e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:25.833349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db97ce-e6c9-4d1b-b3a1-fcc2ca05d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:25.857137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f5db97ce-e6c9-4d1b-b3a1-fcc2ca05d85e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:25.858381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f5db97ce-e6c9-4d1b-b3a1-fcc2ca05d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:25.944464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1149/2316] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:25.946287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54ff9-5592-40ef-ad45-95aefe6fc0d9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:25.946662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54ff9-5592-40ef-ad45-95aefe6fc0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:25.946857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54ff9-5592-40ef-ad45-95aefe6fc0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:25.970058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-63a54ff9-5592-40ef-ad45-95aefe6fc0d9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:25.971532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-63a54ff9-5592-40ef-ad45-95aefe6fc0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:25.980366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1168/2317] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:25.984721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db97ce-e6c9-4d1b-b3a1-fcc2ca05d85e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.002855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db97ce-e6c9-4d1b-b3a1-fcc2ca05d85e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.008326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.010049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.010364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.010710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.011739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:42:26.012288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.014094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.033944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1150/2318] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:42:26.035284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54ff9-5592-40ef-ad45-95aefe6fc0d9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.047459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54ff9-5592-40ef-ad45-95aefe6fc0d9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.051885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.052515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.052799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.053073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.053739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.055988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.094057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1169/2319] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:26 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:42:26.098248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.109725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333f8e3-146d-4f46-8012-2ca4198c0466 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.186538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.187217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.187713 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.188060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.189082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.190792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.213869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:26.222011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1151/2320] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:26 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:26.226000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.245175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8a203-d2a4-404a-a9be-08d5cb7cf049 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.259324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.260103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.260386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.260654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.261353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.262968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.279043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1170/2321] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:26.279257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.290469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a58d16-5301-4de9-aede-7737dbc4f03c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.296304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553efdcf-aa0c-4713-8757-c28b6d6e7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.297030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553efdcf-aa0c-4713-8757-c28b6d6e7f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.297386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553efdcf-aa0c-4713-8757-c28b6d6e7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.297730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553efdcf-aa0c-4713-8757-c28b6d6e7f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.298629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553efdcf-aa0c-4713-8757-c28b6d6e7f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.300374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553efdcf-aa0c-4713-8757-c28b6d6e7f8c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.313769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1152/2322] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:26.317973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.332083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607bed7-36dd-49db-ac44-ce0dc1997460 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.337278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.338469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.338601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.338842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] PATH_INFO: `/v3/projects/f79150f2e573482bbf7f376892814a7e/users/2d81dae2504742b4919ad39e95f15f5c/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.357401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79150f2e573482bbf7f376892814a7e, user_id=2d81dae2504742b4919ad39e95f15f5c, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.360686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.363369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:26.385660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1171/2323] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:26 2022] PUT /identity/v3/projects/f79150f2e573482bbf7f376892814a7e/users/2d81dae2504742b4919ad39e95f15f5c/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:26.398074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9bee-1d17-4a43-9953-7eef0eaf98c2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.398633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9bee-1d17-4a43-9953-7eef0eaf98c2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.399171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9bee-1d17-4a43-9953-7eef0eaf98c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.436336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3b6d9bee-1d17-4a43-9953-7eef0eaf98c2 None None] MFA Rules not processed for user `2d81dae2504742b4919ad39e95f15f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:26.437852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3b6d9bee-1d17-4a43-9953-7eef0eaf98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:26.528056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1153/2324] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:26.532659 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.611327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c758ef-3221-4111-a1a1-087122f3d346 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.617366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.618302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.618654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.619716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.620746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.622275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.657248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1172/2325] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:26 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:26.663876 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9bee-1d17-4a43-9953-7eef0eaf98c2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.678613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9bee-1d17-4a43-9953-7eef0eaf98c2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.753693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.754335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.754621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.754898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.755640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.757643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.781292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1154/2326] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:26 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:26.785170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.796291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f72d6-d471-4654-a2f4-5bb4ede56919 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.801140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.801762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.802043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.802339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.803047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.806885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.817985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1173/2327] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:42:26.821494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.833829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d276e-f683-411c-9c84-c1b7ebe4927a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.839515 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.840315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.840804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.840804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] PATH_INFO: `/v3/projects/9942395f37764b1990c0f5d358f9417e/users/fe9993cd0131428b8132b8526ca58896/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.858263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9942395f37764b1990c0f5d358f9417e, user_id=fe9993cd0131428b8132b8526ca58896, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.860980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.880273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1155/2328] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:26 2022] PUT /identity/v3/projects/9942395f37764b1990c0f5d358f9417e/users/fe9993cd0131428b8132b8526ca58896/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:26.884503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:26.895846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049c31-a4a1-4715-af70-14ff7720e16a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:26.966465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db134c3-fbb7-4352-8749-faf6856c800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:26.967376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db134c3-fbb7-4352-8749-faf6856c800f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:26.967809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db134c3-fbb7-4352-8749-faf6856c800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:26.968443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db134c3-fbb7-4352-8749-faf6856c800f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:26.969264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db134c3-fbb7-4352-8749-faf6856c800f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:26.970957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db134c3-fbb7-4352-8749-faf6856c800f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:26.984514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1174/2329] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:42:26.988784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:27.000529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f322520-9fd5-43ff-9b3f-133f552ff894 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:27.005268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:27.005941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:27.006223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:27.006501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] PATH_INFO: `/v3/projects/9942395f37764b1990c0f5d358f9417e/users/fe9993cd0131428b8132b8526ca58896/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:27.008861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9942395f37764b1990c0f5d358f9417e, user_id=fe9993cd0131428b8132b8526ca58896, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:27.012322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:27.031557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1156/2330] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:26 2022] PUT /identity/v3/projects/9942395f37764b1990c0f5d358f9417e/users/fe9993cd0131428b8132b8526ca58896/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:27.034662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b465d2b-1892-4fba-b0d0-d74b4e2ffd3f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:27.034980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b465d2b-1892-4fba-b0d0-d74b4e2ffd3f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:27.035264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b465d2b-1892-4fba-b0d0-d74b4e2ffd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:27.068172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2b465d2b-1892-4fba-b0d0-d74b4e2ffd3f None None] MFA Rules not processed for user `fe9993cd0131428b8132b8526ca58896`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:27.069402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2b465d2b-1892-4fba-b0d0-d74b4e2ffd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:27.125658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:27.154521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1175/2331] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:27.165611 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:27.168517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:27.211245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:27.241866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16b4b9-c95c-495b-b751-0e52c0bcc319 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:27.247890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc2e2d-2cd4-42b4-b6db-4f23a8cbe756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:27.248772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2e2d-2cd4-42b4-b6db-4f23a8cbe756 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:27.249146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2e2d-2cd4-42b4-b6db-4f23a8cbe756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:27.249482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2e2d-2cd4-42b4-b6db-4f23a8cbe756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:27.329399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc2e2d-2cd4-42b4-b6db-4f23a8cbe756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:27.331714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc2e2d-2cd4-42b4-b6db-4f23a8cbe756 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:27.344474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1157/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:29.976164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b465d2b-1892-4fba-b0d0-d74b4e2ffd3f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:30.038645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b465d2b-1892-4fba-b0d0-d74b4e2ffd3f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:30.043307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:30.043949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:30.044231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:30.044504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] PATH_INFO: `/v3/users/2d81dae2504742b4919ad39e95f15f5c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:30.045660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d81dae2504742b4919ad39e95f15f5c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:30.047639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:30.092575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d81dae2504742b4919ad39e95f15f5c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.099277 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d81dae2504742b4919ad39e95f15f5c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.099925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d81dae2504742b4919ad39e95f15f5c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.107013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d81dae2504742b4919ad39e95f15f5c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.118710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d81dae2504742b4919ad39e95f15f5c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.124524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1176/2333] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:29 2022] DELETE /identity/v3/users/2d81dae2504742b4919ad39e95f15f5c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:30.129001 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c207-7120-4131-92a7-1b961c35693a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:30.129459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c207-7120-4131-92a7-1b961c35693a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:30.129555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c207-7120-4131-92a7-1b961c35693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:30.148531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d703c207-7120-4131-92a7-1b961c35693a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:30.149708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d703c207-7120-4131-92a7-1b961c35693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:30.206917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1158/2334] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:30.217858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:30.219554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:30.279056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a329d-5722-43b3-9e4e-d04d8ab3e42b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:30.282666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:30.283310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:30.283587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:30.283861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:30.293200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:30.294629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:30.303909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1177/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:42:30.576135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703c207-7120-4131-92a7-1b961c35693a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:30.577582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d703c207-7120-4131-92a7-1b961c35693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:30.591846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703c207-7120-4131-92a7-1b961c35693a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:30.596412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:30.597074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:30.597332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:30.597600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] PATH_INFO: `/v3/projects/f79150f2e573482bbf7f376892814a7e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:30.599264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79150f2e573482bbf7f376892814a7e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:30.601337 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:30.647076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79150f2e573482bbf7f376892814a7e', 'request_id': 'req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.653589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79150f2e573482bbf7f376892814a7e', 'request_id': 'req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.659109 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79150f2e573482bbf7f376892814a7e', 'request_id': 'req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.672138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] The token cache is being invalidate because project f79150f2e573482bbf7f376892814a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:30.672412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.673055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.674685 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1159/2336] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:30 2022] DELETE /identity/v3/projects/f79150f2e573482bbf7f376892814a7e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:30.678671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:30.688465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00332-8aaf-403c-98dc-8b236e1fb66d service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:30.696045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:30.746450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:30.747042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:30.747325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:30.747599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] PATH_INFO: `/v3/users/fe9993cd0131428b8132b8526ca58896` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:30.748753 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9993cd0131428b8132b8526ca58896)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:30.750706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:30.797348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9993cd0131428b8132b8526ca58896'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.804125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9993cd0131428b8132b8526ca58896'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.804767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9993cd0131428b8132b8526ca58896'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.812268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9993cd0131428b8132b8526ca58896'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.824829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9993cd0131428b8132b8526ca58896'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:30.830646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1178/2337] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:30 2022] DELETE /identity/v3/users/fe9993cd0131428b8132b8526ca58896 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:42:30.915649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:30.917297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:30.927698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:30.980227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a5d25-b4ef-4aef-95f2-d5ff7dd0dbc2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.032169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983c73a-513d-42cc-bc62-8cbb9cab23cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.032952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c73a-513d-42cc-bc62-8cbb9cab23cc service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.033231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c73a-513d-42cc-bc62-8cbb9cab23cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.033501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c73a-513d-42cc-bc62-8cbb9cab23cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.035304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8983c73a-513d-42cc-bc62-8cbb9cab23cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:31.107557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983c73a-513d-42cc-bc62-8cbb9cab23cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.109319 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983c73a-513d-42cc-bc62-8cbb9cab23cc service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.120190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.122311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:31.125389 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1160/2338] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:31.193937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f18d-cb2e-42b4-8864-c0c86c15aa10 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.198757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.199511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.199952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.200232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] PATH_INFO: `/v3/projects/9942395f37764b1990c0f5d358f9417e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.201413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9942395f37764b1990c0f5d358f9417e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.203406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.248414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:31.263147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9942395f37764b1990c0f5d358f9417e', 'request_id': 'req-79be56fe-28e6-4a63-86e0-86331d4ec04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:31.269091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9942395f37764b1990c0f5d358f9417e', 'request_id': 'req-79be56fe-28e6-4a63-86e0-86331d4ec04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:31.277018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9942395f37764b1990c0f5d358f9417e', 'request_id': 'req-79be56fe-28e6-4a63-86e0-86331d4ec04b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:31.288603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] The token cache is being invalidate because project 9942395f37764b1990c0f5d358f9417e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:31.288894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:31.289581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-79be56fe-28e6-4a63-86e0-86331d4ec04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:31.291155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1179/2339] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:31 2022] DELETE /identity/v3/projects/9942395f37764b1990c0f5d358f9417e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:42:31.296832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474949-79f4-4ac0-8958-4ee24f3c74ad None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.297292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474949-79f4-4ac0-8958-4ee24f3c74ad None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.297408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474949-79f4-4ac0-8958-4ee24f3c74ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.317017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1e474949-79f4-4ac0-8958-4ee24f3c74ad None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:31.318219 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1e474949-79f4-4ac0-8958-4ee24f3c74ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:31.377414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1161/2340] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:31.385078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f169b5-ebfb-4b52-8e9d-a866a0d5ce6b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.385419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f169b5-ebfb-4b52-8e9d-a866a0d5ce6b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.385988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f169b5-ebfb-4b52-8e9d-a866a0d5ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.406244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c4f169b5-ebfb-4b52-8e9d-a866a0d5ce6b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:31.407490 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c4f169b5-ebfb-4b52-8e9d-a866a0d5ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:31.415345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1180/2341] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:31.420106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474949-79f4-4ac0-8958-4ee24f3c74ad None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.429785 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474949-79f4-4ac0-8958-4ee24f3c74ad None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.434369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.435014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.435296 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.435570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.436255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:42:31.436558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.438165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.439841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:31.451829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1162/2342] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:42:31.456169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f169b5-ebfb-4b52-8e9d-a866a0d5ce6b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.466420 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f169b5-ebfb-4b52-8e9d-a866a0d5ce6b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.471194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.471805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.472080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.472347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.473163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.475570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.504046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1181/2343] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:31 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:31.508555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.520561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e04581-1338-4a1a-be3f-33b8377d9602 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.584467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.585103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.585430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.585688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.586333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.588373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.613678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1163/2344] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:31 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:42:31.615955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.627402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f118b-f8cb-4501-ba0a-ea6c583666d6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.632836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.633451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.633728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.633997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.634683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.636802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.647799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1182/2345] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:42:31.652087 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.662316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d8fa-422f-4b87-9882-09c2a5096c36 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.668326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432329-2cb5-4f33-b6a6-dc7a654d9a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.668858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432329-2cb5-4f33-b6a6-dc7a654d9a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.669143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432329-2cb5-4f33-b6a6-dc7a654d9a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.669416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432329-2cb5-4f33-b6a6-dc7a654d9a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.670112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432329-2cb5-4f33-b6a6-dc7a654d9a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.671769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432329-2cb5-4f33-b6a6-dc7a654d9a37 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.683541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1164/2346] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:42:31.688263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.698487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422877-604a-4fb1-9cb0-ec1351f0ac10 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.703238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.703914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.704195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.704468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] PATH_INFO: `/v3/projects/84017ef5874541898dde366fa694af1a/users/6eae21bf5f6e4324bc6d7894c6033191/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.719264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84017ef5874541898dde366fa694af1a, user_id=6eae21bf5f6e4324bc6d7894c6033191, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.721923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.737018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1183/2347] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:31 2022] PUT /identity/v3/projects/84017ef5874541898dde366fa694af1a/users/6eae21bf5f6e4324bc6d7894c6033191/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:31.749044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aab73-f6e5-44d3-a96e-9315f7f3cd4c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.749331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aab73-f6e5-44d3-a96e-9315f7f3cd4c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.749607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aab73-f6e5-44d3-a96e-9315f7f3cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.789021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-078aab73-f6e5-44d3-a96e-9315f7f3cd4c None None] MFA Rules not processed for user `6eae21bf5f6e4324bc6d7894c6033191`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:31.790214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-078aab73-f6e5-44d3-a96e-9315f7f3cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:31.862605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1165/2348] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:31.875393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:31.877137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:31.937690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefd5a9-b4a6-45ba-a7e0-7d86f769e465 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:31.941368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50abf-9e38-4a28-a4e2-def1a9df583b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:31.941992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50abf-9e38-4a28-a4e2-def1a9df583b service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:31.942271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50abf-9e38-4a28-a4e2-def1a9df583b service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:31.942546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50abf-9e38-4a28-a4e2-def1a9df583b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:31.951336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50abf-9e38-4a28-a4e2-def1a9df583b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:31.952771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50abf-9e38-4a28-a4e2-def1a9df583b service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:31.961528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1184/2349] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:33.380333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239928b-a578-4bbe-b2be-51008582fb86 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.380888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239928b-a578-4bbe-b2be-51008582fb86 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.380888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239928b-a578-4bbe-b2be-51008582fb86 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.382366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1166/2350] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:42:33.389868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83007-fd8b-42d5-9020-c79fc56666f7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.390413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83007-fd8b-42d5-9020-c79fc56666f7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.390413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83007-fd8b-42d5-9020-c79fc56666f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.417643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e5e83007-fd8b-42d5-9020-c79fc56666f7 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:33.418918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e5e83007-fd8b-42d5-9020-c79fc56666f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:33.480968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:33.511611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1185/2351] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:33.524558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239928b-a578-4bbe-b2be-51008582fb86 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:33.537184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239928b-a578-4bbe-b2be-51008582fb86 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:33.540989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1bfa8-9cc4-4bcc-9bfe-44d3904a478e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:33.542597 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1bfa8-9cc4-4bcc-9bfe-44d3904a478e service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.542957 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1bfa8-9cc4-4bcc-9bfe-44d3904a478e service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.543339 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1bfa8-9cc4-4bcc-9bfe-44d3904a478e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.553249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1bfa8-9cc4-4bcc-9bfe-44d3904a478e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:33.554748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1bfa8-9cc4-4bcc-9bfe-44d3904a478e service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:33.565496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1167/2352] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:33.632618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab11150-eb31-4e91-8cb4-ebfb235ca4a4 None None] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.632963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab11150-eb31-4e91-8cb4-ebfb235ca4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.633242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab11150-eb31-4e91-8cb4-ebfb235ca4a4 None None] PATH_INFO: `/` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.634612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1186/2353] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 18:42:33.639424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec081-0bb4-4526-a6fb-98c1ad2cbed2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.639716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec081-0bb4-4526-a6fb-98c1ad2cbed2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.639991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec081-0bb4-4526-a6fb-98c1ad2cbed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.660126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ddfec081-0bb4-4526-a6fb-98c1ad2cbed2 None None] MFA Rules not processed for user `235416b3ebfc42f48be079760f271fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:33.661333 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddfec081-0bb4-4526-a6fb-98c1ad2cbed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:33.709222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:33.723753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1168/2354] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:33.736351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab11150-eb31-4e91-8cb4-ebfb235ca4a4 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:33.738140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fab11150-eb31-4e91-8cb4-ebfb235ca4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:33.751520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab11150-eb31-4e91-8cb4-ebfb235ca4a4 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:33.755138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f4b70-7f41-421d-a436-50fa65e56373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:33.755746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4b70-7f41-421d-a436-50fa65e56373 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.756026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4b70-7f41-421d-a436-50fa65e56373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.756300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4b70-7f41-421d-a436-50fa65e56373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.763864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f4b70-7f41-421d-a436-50fa65e56373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:33.765302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f4b70-7f41-421d-a436-50fa65e56373 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:33.773193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1187/2355] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:33.855917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d3350-1d2d-4e8c-b64f-4548af7f6e7c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.856204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d3350-1d2d-4e8c-b64f-4548af7f6e7c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.856481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d3350-1d2d-4e8c-b64f-4548af7f6e7c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.857848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1169/2356] 10.222.0.20 () {54 vars in 921 bytes} [Sun Jul 31 18:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 18:42:33.863006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3110a-c8fa-4b39-9b66-3944d304bd74 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.863294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3110a-c8fa-4b39-9b66-3944d304bd74 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.863568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3110a-c8fa-4b39-9b66-3944d304bd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.883159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6af3110a-c8fa-4b39-9b66-3944d304bd74 None None] MFA Rules not processed for user `31e9920dd81b4f0a8a28a4e8ebef2ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:33.884377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6af3110a-c8fa-4b39-9b66-3944d304bd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:33.894855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1188/2357] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Jul 31 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:33.906321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d3350-1d2d-4e8c-b64f-4548af7f6e7c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:33.908199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-123d3350-1d2d-4e8c-b64f-4548af7f6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:33.921718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d3350-1d2d-4e8c-b64f-4548af7f6e7c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:33.926198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:33.926979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:33.927381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:33.927719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:33.942361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:33.944659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:33.959440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1170/2358] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:35.572081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a760159-05fe-4e40-9af6-8a21c42adf27 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:35.573096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a760159-05fe-4e40-9af6-8a21c42adf27 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:35.573240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a760159-05fe-4e40-9af6-8a21c42adf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:35.593905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2a760159-05fe-4e40-9af6-8a21c42adf27 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:35.595191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2a760159-05fe-4e40-9af6-8a21c42adf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:35.654095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1189/2359] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:42:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:35.666767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:35.668359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:35.738231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029bf1-7050-48c8-b490-cae017f46f69 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:35.745778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:35.746415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:35.746696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:35.746999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:35.756673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:35.758454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:35.768545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1171/2360] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:42:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:42:36.993039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a760159-05fe-4e40-9af6-8a21c42adf27 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:37.004642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a760159-05fe-4e40-9af6-8a21c42adf27 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:37.008824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:37.009683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:37.010142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:37.010572 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:37.012745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:37.032082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:37.033543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:37.045859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1190/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:40.612671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:40.614151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:40.630733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379b534-ab38-4405-9389-ed2ff455fac0 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:40.637402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:40.638027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:40.638308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:40.638584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:40.640367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:40.706803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:40.708368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:40.722121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1172/2362] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:47.040037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=44 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:47.612020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:47.623767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf7cc9-6a2c-43e2-99bd-c85cb918ed67 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:47.629216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da225d-d47d-49cd-a809-4b2c24c335c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:47.629817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da225d-d47d-49cd-a809-4b2c24c335c1 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:47.630091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da225d-d47d-49cd-a809-4b2c24c335c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:47.630361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da225d-d47d-49cd-a809-4b2c24c335c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:47.632088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d7da225d-d47d-49cd-a809-4b2c24c335c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:47.688850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da225d-d47d-49cd-a809-4b2c24c335c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:47.690424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da225d-d47d-49cd-a809-4b2c24c335c1 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:47.699456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1191/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:50.449970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:50.463676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15fb5-063e-4846-ac92-4cdd661035f2 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:50.467816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:50.468705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:50.469072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:50.469415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:50.471590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:50.486980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:50.488549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:50.497524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1173/2364] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:52.315523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64052bec-bea5-4fbb-8acc-814944028035 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:52.316029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64052bec-bea5-4fbb-8acc-814944028035 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:52.316116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64052bec-bea5-4fbb-8acc-814944028035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:52.336536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-64052bec-bea5-4fbb-8acc-814944028035 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:52.337764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-64052bec-bea5-4fbb-8acc-814944028035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:52.345300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1192/2365] 10.222.0.20 () {58 vars in 967 bytes} [Sun Jul 31 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:52.357479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:52.370218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde803e1-c855-4fd1-a4a9-356e53443947 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:52.375208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:52.375814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:52.376088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:52.376360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:52.384473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:52.386587 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:52.395587 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1174/2366] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:42:53.962271 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64052bec-bea5-4fbb-8acc-814944028035 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:53.974946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64052bec-bea5-4fbb-8acc-814944028035 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:53.981072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:53.981690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:53.981966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:53.982232 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:53.984015 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:54.048272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:54.049872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:54.059385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1193/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:54.889053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:54.904150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56001f-fafc-46b0-af2c-abba49ac87f3 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:54.910983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a28ef-1969-40f0-87ed-0f40a27ab949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:54.911650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a28ef-1969-40f0-87ed-0f40a27ab949 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:54.911930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a28ef-1969-40f0-87ed-0f40a27ab949 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:54.912411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a28ef-1969-40f0-87ed-0f40a27ab949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:54.914610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bb0a28ef-1969-40f0-87ed-0f40a27ab949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:54.928802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a28ef-1969-40f0-87ed-0f40a27ab949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:54.930675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a28ef-1969-40f0-87ed-0f40a27ab949 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:54.943728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1175/2368] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:55.777291 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:55.894140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706fa3-3fbe-413a-ad30-0b6c0b662e70 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:55.900005 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:55.900642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:55.900923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:55.901198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] PATH_INFO: `/v3/users/6eae21bf5f6e4324bc6d7894c6033191` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:55.903522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eae21bf5f6e4324bc6d7894c6033191)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:55.905630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:55.952144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:55.968079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eae21bf5f6e4324bc6d7894c6033191'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:55.975738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eae21bf5f6e4324bc6d7894c6033191'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:55.976540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eae21bf5f6e4324bc6d7894c6033191'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:55.985665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eae21bf5f6e4324bc6d7894c6033191'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:55.998638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eae21bf5f6e4324bc6d7894c6033191'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:56.004612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1194/2369] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:42:55 2022] DELETE /identity/v3/users/6eae21bf5f6e4324bc6d7894c6033191 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:56.009177 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.009638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.009735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.030877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:56.032757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:56.063522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:56.099863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1176/2370] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:56.110497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:56.112683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:56.185126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e107c6-17f0-4e3d-a0ee-1cb6331fcbfa admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:56.188839 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee7998-8b7c-4828-85a5-7e4e2ed81645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:56.189535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7998-8b7c-4828-85a5-7e4e2ed81645 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.189816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7998-8b7c-4828-85a5-7e4e2ed81645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.190089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7998-8b7c-4828-85a5-7e4e2ed81645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.200094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7998-8b7c-4828-85a5-7e4e2ed81645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:56.201541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7998-8b7c-4828-85a5-7e4e2ed81645 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:56.212061 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1195/2371] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:56.519199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:56.521144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:56.536589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f7b20-cc87-43e9-9246-b281eb83b1dc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:56.548112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:56.549195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.549774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.549881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] PATH_INFO: `/v3/projects/84017ef5874541898dde366fa694af1a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.551358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84017ef5874541898dde366fa694af1a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:56.553299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:56.609955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84017ef5874541898dde366fa694af1a', 'request_id': 'req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:56.616214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84017ef5874541898dde366fa694af1a', 'request_id': 'req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:56.623511 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84017ef5874541898dde366fa694af1a', 'request_id': 'req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:56.639446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] The token cache is being invalidate because project 84017ef5874541898dde366fa694af1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:42:56.639839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:56.640481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f32aa5d8-95cf-49c8-8973-b87dc2c03ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:42:56.642670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1177/2372] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:42:56 2022] DELETE /identity/v3/projects/84017ef5874541898dde366fa694af1a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:42:56.647681 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a04697-f1f8-4e26-b3ff-2bcd6416f306 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.647959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a04697-f1f8-4e26-b3ff-2bcd6416f306 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.648228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a04697-f1f8-4e26-b3ff-2bcd6416f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.670542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b3a04697-f1f8-4e26-b3ff-2bcd6416f306 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:56.671787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b3a04697-f1f8-4e26-b3ff-2bcd6416f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:56.744027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1196/2373] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:56.753443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d313d1-968f-4be4-b757-088e915eb0fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.753822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d313d1-968f-4be4-b757-088e915eb0fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.754107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d313d1-968f-4be4-b757-088e915eb0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.777656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e1d313d1-968f-4be4-b757-088e915eb0fa None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:56.779074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e1d313d1-968f-4be4-b757-088e915eb0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:56.787411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1178/2374] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:42:56.791779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a04697-f1f8-4e26-b3ff-2bcd6416f306 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:56.805091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a04697-f1f8-4e26-b3ff-2bcd6416f306 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:56.811236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:56.811873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.812150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.812419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.813140 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:42:56.813457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:56.815074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:56.827593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1197/2375] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:42:56.832682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d313d1-968f-4be4-b757-088e915eb0fa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:56.844428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d313d1-968f-4be4-b757-088e915eb0fa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:56.849131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:56.849748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.850025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.850295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.850985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:56.853097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:56.882970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1179/2376] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:42:56 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:42:56.886116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:56.897430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c57a-88dd-42bc-928a-2b71987ad26e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:56.939133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:56.960011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:56.960548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:56.960827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:56.961096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:56.961785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:56.963774 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:56.990355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1198/2377] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:42:56 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:42:56.991791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:57.002502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fa651-716d-44ff-b6d5-ad159f0fbcfb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:57.007440 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:57.008065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:57.008346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:57.008623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:57.009322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:57.011787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:57.022925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1180/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:57.026984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:57.037829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a940c4-908f-400a-a1c1-cc00c7c14981 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:57.044016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0dcd-a6e5-4569-b100-fe7451062ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:57.044635 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0dcd-a6e5-4569-b100-fe7451062ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:57.044938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0dcd-a6e5-4569-b100-fe7451062ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:57.045223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0dcd-a6e5-4569-b100-fe7451062ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:57.045906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce0dcd-a6e5-4569-b100-fe7451062ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:57.047548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce0dcd-a6e5-4569-b100-fe7451062ddf admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:57.057875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1199/2379] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:42:57.062193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:57.072619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ed782-edc1-44d1-835d-872d5287bcd5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:57.078899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:57.079682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:57.079954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:57.080225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] PATH_INFO: `/v3/projects/86ef8142407e421b95e9f818da7419ad/users/d8c3752f78be48d293440ffbe53af2c3/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:57.096743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ef8142407e421b95e9f818da7419ad, user_id=d8c3752f78be48d293440ffbe53af2c3, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:57.099431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:57.113258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1181/2380] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:42:57 2022] PUT /identity/v3/projects/86ef8142407e421b95e9f818da7419ad/users/d8c3752f78be48d293440ffbe53af2c3/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:42:57.118680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17948d7-bcc9-43eb-a3a2-d65669738aa6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:57.119006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17948d7-bcc9-43eb-a3a2-d65669738aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:57.119290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17948d7-bcc9-43eb-a3a2-d65669738aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:57.140552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f17948d7-bcc9-43eb-a3a2-d65669738aa6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:57.142032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f17948d7-bcc9-43eb-a3a2-d65669738aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:57.205154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1200/2381] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:57.216246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:57.218649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:57.282662 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16abba-85cf-4f4c-9882-0f662819acbf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:57.288451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:57.289211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:57.289564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:57.289909 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:57.303771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:57.306702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:57.310598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:57.323363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1182/2382] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:58.036590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce267a7-48f2-4876-8e48-87c36bf751fb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:58.037282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce267a7-48f2-4876-8e48-87c36bf751fb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:58.037282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce267a7-48f2-4876-8e48-87c36bf751fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:58.067983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bce267a7-48f2-4876-8e48-87c36bf751fb None None] MFA Rules not processed for user `d8c3752f78be48d293440ffbe53af2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:58.069299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bce267a7-48f2-4876-8e48-87c36bf751fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:58.138652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1201/2383] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:58.149979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:58.152053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:58.210335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1025-f44b-4798-981b-5a3a46dc323a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:58.214040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:58.214644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:58.214925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:58.215231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:58.224682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:58.226128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:58.235625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1183/2384] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:42:59.610057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:59.610554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:59.610652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:59.630172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] MFA Rules not processed for user `d8c3752f78be48d293440ffbe53af2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:42:59.631421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:59.638952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1202/2385] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:42:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:42:59.893038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:42:59.895217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:59.908507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7557c9-6080-4d0f-a09a-13c6b8428d7c service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:42:59.913058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:42:59.913675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:42:59.913958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:42:59.914288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:42:59.916589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:42:59.939777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:42:59.941315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:42:59.950295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1184/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:42:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:00.267685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:00.269857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:00.328620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:00.346524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:00.355050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecfabc-a739-4085-99dd-14bb0afb0529 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:00.358809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:00.359482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:00.359767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:00.360041 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:00.360894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36082c14-f35d-4884-84ac-f3df111d9180 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:00.361884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:00.365849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:00.366461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:00.366738 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:00.367041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:00.368736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:00.375638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:00.377077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:00.380959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:00.382611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:00.387764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1185/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:00.394707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1203/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:04.828563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:04.830127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:04.842342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb6fa3-1ee1-4cef-97a3-2be912754b6a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:04.847141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:04.847787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:04.848186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:04.848348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] PATH_INFO: `/v3/users/ae2fc4f8451e4cfebeca4d8a3916a828` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:04.850805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2fc4f8451e4cfebeca4d8a3916a828)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:04.852401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:04.898548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2fc4f8451e4cfebeca4d8a3916a828'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:04.899222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2fc4f8451e4cfebeca4d8a3916a828'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:04.907230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2fc4f8451e4cfebeca4d8a3916a828'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:04.914021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2fc4f8451e4cfebeca4d8a3916a828'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:04.914636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ceb6b98d-1f5d-452f-900c-056793fb10c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2fc4f8451e4cfebeca4d8a3916a828'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:04.932541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1186/2389] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:04 2022] DELETE /identity/v3/users/ae2fc4f8451e4cfebeca4d8a3916a828 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:05.106900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.120888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089075-2e3b-48b2-b524-1f0fbc2a4658 service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.178223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.178869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.179188 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.179460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] PATH_INFO: `/v3/projects/d454abd075e54da496dcd9e8080c611f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.180627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d454abd075e54da496dcd9e8080c611f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.183180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.231037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd454abd075e54da496dcd9e8080c611f', 'request_id': 'req-86fa6fff-e588-4a85-95bf-899e12bca372'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:05.236437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd454abd075e54da496dcd9e8080c611f', 'request_id': 'req-86fa6fff-e588-4a85-95bf-899e12bca372'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:05.243714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd454abd075e54da496dcd9e8080c611f', 'request_id': 'req-86fa6fff-e588-4a85-95bf-899e12bca372'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:05.255147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] The token cache is being invalidate because project d454abd075e54da496dcd9e8080c611f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:05.255431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:05.256048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-86fa6fff-e588-4a85-95bf-899e12bca372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:05.257545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1204/2390] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:05 2022] DELETE /identity/v3/projects/d454abd075e54da496dcd9e8080c611f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:05.263083 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89995-095f-41d4-bd4d-1cde141b1a5b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.263374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89995-095f-41d4-bd4d-1cde141b1a5b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.263649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89995-095f-41d4-bd4d-1cde141b1a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.283544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-10e89995-095f-41d4-bd4d-1cde141b1a5b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:05.284741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-10e89995-095f-41d4-bd4d-1cde141b1a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:05.325601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:05.345903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1187/2391] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:05.354957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec8046-2d18-44b6-a6d9-2a4f6838127b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.355428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec8046-2d18-44b6-a6d9-2a4f6838127b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.355701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec8046-2d18-44b6-a6d9-2a4f6838127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.375992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-37ec8046-2d18-44b6-a6d9-2a4f6838127b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:05.377183 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-37ec8046-2d18-44b6-a6d9-2a4f6838127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:05.384933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1205/2392] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:05.389374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89995-095f-41d4-bd4d-1cde141b1a5b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.399524 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89995-095f-41d4-bd4d-1cde141b1a5b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.404306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.404925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.405201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.405470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.406184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:05.406483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.408093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.420249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1188/2393] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:05.430923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec8046-2d18-44b6-a6d9-2a4f6838127b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.442258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec8046-2d18-44b6-a6d9-2a4f6838127b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.447312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.447934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.448248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.448519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.449189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.451155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.481196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1206/2394] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:05 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:05.485390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.495711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f12b6e-372b-48bf-af5f-6d66436bd687 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.553589 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.554080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.554391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.554614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.555491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.558187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.581144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1189/2395] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:05 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:05.585230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.596180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a232-a6a3-4a4b-bbc5-c5c6c45d12d5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.600952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.601585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.601861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.602161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.602843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.605051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.615009 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1207/2396] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:05.618820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.628851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ceedf-33ff-40f5-8ab3-88bed4d2ad8e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.633407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f8043-a35a-48be-8280-726cfec751c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.634010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8043-a35a-48be-8280-726cfec751c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.634290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8043-a35a-48be-8280-726cfec751c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.634579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8043-a35a-48be-8280-726cfec751c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.635270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f8043-a35a-48be-8280-726cfec751c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.636896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f8043-a35a-48be-8280-726cfec751c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.647786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1190/2397] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:05.652892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.662643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3aef0-6582-4572-ba2b-9febc5143bc5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.667958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.668667 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.668923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.669191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] PATH_INFO: `/v3/projects/59806816571b41cabb126898cd554e7a/users/c912f43d0fc640f6895392501e0e2c25/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.684094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59806816571b41cabb126898cd554e7a, user_id=c912f43d0fc640f6895392501e0e2c25, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.686792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.695861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:05.702765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1208/2398] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:05 2022] PUT /identity/v3/projects/59806816571b41cabb126898cd554e7a/users/c912f43d0fc640f6895392501e0e2c25/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:05.713190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.713632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.713967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.744020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] MFA Rules not processed for user `c912f43d0fc640f6895392501e0e2c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:05.745169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:05.822305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1191/2399] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:05.833400 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:05.835150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:05.903387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226ec30-4249-46bf-8324-24b04b24f569 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:05.907377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:05.908106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:05.908489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:05.908978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:05.919762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:05.921114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:05.939307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1209/2400] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:08.063151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:08.064941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:08.117353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:08.168351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca542f-9934-43f5-855c-e940143f89d7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:08.174813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:08.175579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:08.175970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:08.176336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:08.178275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:08.192048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:08.193852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:08.211160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1192/2401] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:12.754896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:12.756422 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:12.814979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9bfb-3c65-480c-ad5d-45022250613d service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:12.818491 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab8f40-b0aa-4d43-aa6f-4f0fd3b0923a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:12.819133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8f40-b0aa-4d43-aa6f-4f0fd3b0923a service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:12.819417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8f40-b0aa-4d43-aa6f-4f0fd3b0923a service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:12.819687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8f40-b0aa-4d43-aa6f-4f0fd3b0923a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:12.821421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f4ab8f40-b0aa-4d43-aa6f-4f0fd3b0923a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:12.882283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab8f40-b0aa-4d43-aa6f-4f0fd3b0923a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:12.883797 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab8f40-b0aa-4d43-aa6f-4f0fd3b0923a service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:12.894128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1210/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:14.426576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:14.438766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637d7d-549b-49ca-bd57-26d2da7050f0 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:14.445131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:14.445918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:14.446332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:14.446697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] PATH_INFO: `/v3/users/c912f43d0fc640f6895392501e0e2c25` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:14.448047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c912f43d0fc640f6895392501e0e2c25)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:14.450803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:14.508079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c912f43d0fc640f6895392501e0e2c25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:14.508687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c912f43d0fc640f6895392501e0e2c25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:14.518782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c912f43d0fc640f6895392501e0e2c25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:14.527842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c912f43d0fc640f6895392501e0e2c25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:14.528498 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c912f43d0fc640f6895392501e0e2c25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:14.556315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1193/2403] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:14 2022] DELETE /identity/v3/users/c912f43d0fc640f6895392501e0e2c25 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:14.559554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:14.560268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:14.562701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:14.592632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:14.595114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:14.650744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:14.670159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1211/2404] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:14.680499 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:14.682168 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:14.748575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eaa0d-fe90-4982-be2c-666519b34531 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:14.752714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4b541-da8c-48be-8b33-c162b6c03678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:14.753360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4b541-da8c-48be-8b33-c162b6c03678 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:14.753619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4b541-da8c-48be-8b33-c162b6c03678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:14.753906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4b541-da8c-48be-8b33-c162b6c03678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:14.764799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4b541-da8c-48be-8b33-c162b6c03678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:14.769594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4b541-da8c-48be-8b33-c162b6c03678 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:14.798068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1194/2405] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:15.105016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:15.106754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:15.121105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb891a3-e2d9-42cd-af10-dd3c87e4c026 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:15.129764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:15.130537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.130912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.131319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] PATH_INFO: `/v3/projects/59806816571b41cabb126898cd554e7a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.132579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59806816571b41cabb126898cd554e7a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:15.134683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:15.189770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59806816571b41cabb126898cd554e7a', 'request_id': 'req-73987089-28ff-4485-9e70-f3fd82d3ef7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:15.195637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59806816571b41cabb126898cd554e7a', 'request_id': 'req-73987089-28ff-4485-9e70-f3fd82d3ef7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:15.206092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59806816571b41cabb126898cd554e7a', 'request_id': 'req-73987089-28ff-4485-9e70-f3fd82d3ef7c'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:15.221641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] The token cache is being invalidate because project 59806816571b41cabb126898cd554e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:15.222197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:15.222829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-73987089-28ff-4485-9e70-f3fd82d3ef7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:15.225127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1212/2406] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:15 2022] DELETE /identity/v3/projects/59806816571b41cabb126898cd554e7a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:15.230133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24dcf8-ea6f-48d3-a246-c74889ade1b5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.230459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24dcf8-ea6f-48d3-a246-c74889ade1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.230766 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24dcf8-ea6f-48d3-a246-c74889ade1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.250346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-af24dcf8-ea6f-48d3-a246-c74889ade1b5 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:15.252009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af24dcf8-ea6f-48d3-a246-c74889ade1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:15.297361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:15.335229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1195/2407] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:15.343964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5aab8-5993-441c-9878-325f6f2268f6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.344796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5aab8-5993-441c-9878-325f6f2268f6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.344796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5aab8-5993-441c-9878-325f6f2268f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.366739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-abe5aab8-5993-441c-9878-325f6f2268f6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:15.367776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-abe5aab8-5993-441c-9878-325f6f2268f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:15.378737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1213/2408] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:15.383081 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24dcf8-ea6f-48d3-a246-c74889ade1b5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:15.397679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24dcf8-ea6f-48d3-a246-c74889ade1b5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:15.403015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:15.403729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.404014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.404313 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.405048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:15.405349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:15.407094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:15.424906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1196/2409] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:15.429743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5aab8-5993-441c-9878-325f6f2268f6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:15.443476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5aab8-5993-441c-9878-325f6f2268f6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:15.448105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:15.449323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.449597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.449943 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.450608 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:15.452553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:15.488023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1214/2410] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:15 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:15.492111 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:15.505348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af672-1102-4293-8ba4-c9ac15cf1e2b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:15.576893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:15.577428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.577706 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.577980 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.578657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:15.580619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:15.601655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1197/2411] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:15 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:15.606791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:15.627957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad70e-587a-4cd4-8f53-d7bfb23bbd25 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:15.636075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:15.636734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.637013 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.637315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.638028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:15.639694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:15.653830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1215/2412] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:15.655047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:15.665228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63571b83-4e5b-4a80-b680-54982bbe42d0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:15.670458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00596dca-9dad-41a2-b835-bca1d5308d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:15.671119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00596dca-9dad-41a2-b835-bca1d5308d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.671410 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00596dca-9dad-41a2-b835-bca1d5308d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.671688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00596dca-9dad-41a2-b835-bca1d5308d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.672382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00596dca-9dad-41a2-b835-bca1d5308d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:15.674172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00596dca-9dad-41a2-b835-bca1d5308d8c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:15.694161 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1198/2413] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:15.698174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:15.723202 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38aa2d-3519-4d6a-b705-84587cce2ac4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:15.732293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:15.734142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.734965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.735804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] PATH_INFO: `/v3/projects/2cdf1a9737e2413780365bfe060040ed/users/12fc12e4f79f47b0b16140a3c74bfe94/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.764965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdf1a9737e2413780365bfe060040ed, user_id=12fc12e4f79f47b0b16140a3c74bfe94, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:15.768594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:15.789076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1216/2414] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:15 2022] PUT /identity/v3/projects/2cdf1a9737e2413780365bfe060040ed/users/12fc12e4f79f47b0b16140a3c74bfe94/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:15.802530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:15.802974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:15.807273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:15.847607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] MFA Rules not processed for user `12fc12e4f79f47b0b16140a3c74bfe94`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:15.849134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:15.940461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1199/2415] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:15.944945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.038962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1f4bc-c6ba-431e-9ab1-485cbf6f5267 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.045829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.046693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.047089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.047463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.048318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.050886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.078115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.081436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.093308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:16.104452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4896dbe-152b-4d34-bdf0-f10aa72c59c9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.111051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.112036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.112973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.113425 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] PATH_INFO: `/v3/users/3f9cc8143db243deae4184622a4a2a26` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.114858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9cc8143db243deae4184622a4a2a26)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.119748 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.131897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1217/2416] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:15 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:16.137443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.192540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:16.217042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9cc8143db243deae4184622a4a2a26'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.217042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9cc8143db243deae4184622a4a2a26'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.227778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9cc8143db243deae4184622a4a2a26'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.239717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9cc8143db243deae4184622a4a2a26'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.240392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9cc8143db243deae4184622a4a2a26'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.247101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6e92-19ef-4bee-9ee0-e881b776ac62 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.253350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.253984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.254261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.254535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.255335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.257787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.258211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1200/2417] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:16 2022] DELETE /identity/v3/users/3f9cc8143db243deae4184622a4a2a26 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:16.283300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1218/2418] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:16 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:16.285382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.286804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.371787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bbaa-5f93-4543-a6ac-a20164fc868a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.376907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.377536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.377821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.378095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.378795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.380446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.391518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1201/2419] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:16.395712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.406343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473c9fe-5635-4576-a560-c6c86b8ca593 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.411099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.411770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.412081 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.412358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] PATH_INFO: `/v3/projects/d377177cddc1477691e82cafbaa97033/users/bff13aa1d0ea47eeafe0a18f4c59ae06/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.435543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d377177cddc1477691e82cafbaa97033, user_id=bff13aa1d0ea47eeafe0a18f4c59ae06, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.438447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.453197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1219/2420] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:16 2022] PUT /identity/v3/projects/d377177cddc1477691e82cafbaa97033/users/bff13aa1d0ea47eeafe0a18f4c59ae06/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:16.457602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.457738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.460017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.471450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3386a-ec30-4be4-a715-cf2ad06f9f41 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.538834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.539740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.539972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.540155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.540844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.542487 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.542686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0855-df32-49b0-a0f2-a5c91f6b47a6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.547743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.548387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.548675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.548947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] PATH_INFO: `/v3/projects/78f0767fee4a48c99d13bf34131c4282` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.550133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f0767fee4a48c99d13bf34131c4282)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.552077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.553767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1202/2421] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:16.558961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.568528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9c4dc-16cf-4b48-a829-c6e6804190d1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.573229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2634b-572c-4c75-b760-5995365d91c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.574625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2634b-572c-4c75-b760-5995365d91c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.574954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2634b-572c-4c75-b760-5995365d91c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.575235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2634b-572c-4c75-b760-5995365d91c7 admin admin] PATH_INFO: `/v3/projects/d377177cddc1477691e82cafbaa97033/users/bff13aa1d0ea47eeafe0a18f4c59ae06/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.577388 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2634b-572c-4c75-b760-5995365d91c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d377177cddc1477691e82cafbaa97033, user_id=bff13aa1d0ea47eeafe0a18f4c59ae06, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.580238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2634b-572c-4c75-b760-5995365d91c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.593719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1203/2422] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:16 2022] PUT /identity/v3/projects/d377177cddc1477691e82cafbaa97033/users/bff13aa1d0ea47eeafe0a18f4c59ae06/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:16.601475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f0767fee4a48c99d13bf34131c4282', 'request_id': 'req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.606966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.606966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.606966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.610499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f0767fee4a48c99d13bf34131c4282', 'request_id': 'req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.614830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:16.621612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f0767fee4a48c99d13bf34131c4282', 'request_id': 'req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.634901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] The token cache is being invalidate because project 78f0767fee4a48c99d13bf34131c4282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:16.635218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.636480 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-70e45ed2-6fb7-4f10-9c0a-d58dcf919599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:16.638264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1220/2423] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:16 2022] DELETE /identity/v3/projects/78f0767fee4a48c99d13bf34131c4282 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:16.640570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] MFA Rules not processed for user `bff13aa1d0ea47eeafe0a18f4c59ae06`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:16.642046 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.643525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60134-e65d-437c-bb6b-755a9ab1d142 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.643816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60134-e65d-437c-bb6b-755a9ab1d142 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.644201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60134-e65d-437c-bb6b-755a9ab1d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.655384 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:16.665549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e6a60134-e65d-437c-bb6b-755a9ab1d142 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:16.666835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e6a60134-e65d-437c-bb6b-755a9ab1d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.719157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1204/2424] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:16.731409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.732777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.735671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1221/2425] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:16.743251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8abcb-d805-4c37-8ec2-83044ac5210d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.743598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8abcb-d805-4c37-8ec2-83044ac5210d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.743947 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8abcb-d805-4c37-8ec2-83044ac5210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.767894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-55f8abcb-d805-4c37-8ec2-83044ac5210d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:16.769565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-55f8abcb-d805-4c37-8ec2-83044ac5210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.778556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1222/2426] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:16.782865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8abcb-d805-4c37-8ec2-83044ac5210d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.791854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8abcb-d805-4c37-8ec2-83044ac5210d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.796868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.797489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.797765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.798038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.798731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:16.799085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.800696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.805735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219fc75-efb0-4ed8-80a9-0563e23d242e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.809870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.810489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.810763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.811066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.812813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:16.813535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1223/2427] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:43:16.817773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.828024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5021a9c-849c-4b03-8d60-16439f4a6bb7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.832590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.833184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.833458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.833732 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.834380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.836287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.863851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1224/2428] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:16 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:16.868558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.873549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.875112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.884352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1205/2429] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:16.944327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa24d-046e-4c08-b9b0-48af1e2d0fd5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.949719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.950465 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.950749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.951054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:16.951716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:16.953658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:16.976074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1225/2430] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:16 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:16.980430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:16.991618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26bc6e-45f0-4c80-a36b-80e3a29deced service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:16.998069 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:16.998806 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:16.999204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:16.999566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:17.000264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:17.001869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:17.013910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1206/2431] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:17.018485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:17.029836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5a52-d752-4f07-ad4d-1cc8fb87b5c2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:17.035438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800cfe5-b060-44f7-970b-3e0f0760c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:17.036060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800cfe5-b060-44f7-970b-3e0f0760c652 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:17.036338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800cfe5-b060-44f7-970b-3e0f0760c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:17.036640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800cfe5-b060-44f7-970b-3e0f0760c652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:17.037324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800cfe5-b060-44f7-970b-3e0f0760c652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:17.038914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800cfe5-b060-44f7-970b-3e0f0760c652 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:17.050630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1226/2432] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:17.055971 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:17.068878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c6b38-3d22-4ecc-aad6-cdb42b44bb9e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:17.076429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:17.077169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:17.077614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:17.077893 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] PATH_INFO: `/v3/projects/f0c48fac349c411c9ee44bd41c79773f/users/aecbb3e496184cb0a4c4616f16b0c35e/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:17.094095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c48fac349c411c9ee44bd41c79773f, user_id=aecbb3e496184cb0a4c4616f16b0c35e, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:17.097040 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:17.112059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1207/2433] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:17 2022] PUT /identity/v3/projects/f0c48fac349c411c9ee44bd41c79773f/users/aecbb3e496184cb0a4c4616f16b0c35e/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:17.123215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f063f-e924-49c9-b206-d115844263b8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:17.123430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f063f-e924-49c9-b206-d115844263b8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:17.123703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f063f-e924-49c9-b206-d115844263b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:17.153824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-7a7f063f-e924-49c9-b206-d115844263b8 None None] MFA Rules not processed for user `aecbb3e496184cb0a4c4616f16b0c35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:17.155043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7a7f063f-e924-49c9-b206-d115844263b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:17.173991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:17.249432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1227/2434] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:17.261753 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:17.263920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:17.305152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:17.345715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b716d4-3b3a-4e75-a548-36351dfdd40d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:17.351314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:17.351925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:17.352200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:17.352466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:17.360773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:17.362363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:17.372239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1208/2435] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:18.301029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f063f-e924-49c9-b206-d115844263b8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:18.355590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f063f-e924-49c9-b206-d115844263b8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:18.358780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33c37f-c7d2-492d-acdc-0ee755235e40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:18.359427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33c37f-c7d2-492d-acdc-0ee755235e40 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:18.359698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33c37f-c7d2-492d-acdc-0ee755235e40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:18.359968 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33c37f-c7d2-492d-acdc-0ee755235e40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:18.419855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33c37f-c7d2-492d-acdc-0ee755235e40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:18.421288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33c37f-c7d2-492d-acdc-0ee755235e40 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:18.430996 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1228/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:22.227555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:22.229004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:22.294892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74f8bc-2565-441b-a496-6cf3f7ea4312 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:22.299577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:22.300156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:22.300437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:22.300714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] PATH_INFO: `/v3/users/12fc12e4f79f47b0b16140a3c74bfe94` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:22.301868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fc12e4f79f47b0b16140a3c74bfe94)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:22.303839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:22.350044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fc12e4f79f47b0b16140a3c74bfe94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.350673 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fc12e4f79f47b0b16140a3c74bfe94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.358532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fc12e4f79f47b0b16140a3c74bfe94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.365464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fc12e4f79f47b0b16140a3c74bfe94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.366093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fc12e4f79f47b0b16140a3c74bfe94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.383601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1209/2437] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:22 2022] DELETE /identity/v3/users/12fc12e4f79f47b0b16140a3c74bfe94 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:22.388248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:22.388711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:22.388806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:22.408056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:22.409237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:22.468460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1229/2438] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:22.479482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:22.481908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:22.533903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:22.559459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a996d8-3cf0-40ab-afb0-0b018fb2a482 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:22.561567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e603238-23e3-4c2a-8b8e-a49419785547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:22.562193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e603238-23e3-4c2a-8b8e-a49419785547 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:22.562471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e603238-23e3-4c2a-8b8e-a49419785547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:22.562741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e603238-23e3-4c2a-8b8e-a49419785547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:22.572888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e603238-23e3-4c2a-8b8e-a49419785547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:22.574347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e603238-23e3-4c2a-8b8e-a49419785547 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:22.594273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1210/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:22.604966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:22.605428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:22.618526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23385c25-34b1-42d8-a7bc-27c2c6cf3023 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:22.623524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:22.624314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:22.624442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:22.624710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] PATH_INFO: `/v3/users/aecbb3e496184cb0a4c4616f16b0c35e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:22.625891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecbb3e496184cb0a4c4616f16b0c35e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:22.628036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:22.630407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:22.678680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecbb3e496184cb0a4c4616f16b0c35e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.686886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecbb3e496184cb0a4c4616f16b0c35e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.687615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecbb3e496184cb0a4c4616f16b0c35e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.695792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecbb3e496184cb0a4c4616f16b0c35e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.709120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecbb3e496184cb0a4c4616f16b0c35e'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.715012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1230/2440] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:22 2022] DELETE /identity/v3/users/aecbb3e496184cb0a4c4616f16b0c35e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:22.720136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:22.720424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:22.720703 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:22.740338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:22.741797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:22.810736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1211/2441] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:22.820461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:22.821883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:22.885257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956c8d-4598-4fb4-8eae-dbdd2fcd5d5c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:22.889288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:22.889935 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:22.890234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:22.890505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:22.892443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:22.894186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:22.901251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:22.902796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:22.907797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cdab6-09d8-40e6-8515-7fd2ecbafec5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:22.912424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:22.913348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:22.913483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:22.913653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1231/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:22.914014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] PATH_INFO: `/v3/projects/2cdf1a9737e2413780365bfe060040ed` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:22.915383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdf1a9737e2413780365bfe060040ed)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:22.917424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:22.970772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdf1a9737e2413780365bfe060040ed', 'request_id': 'req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.979251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdf1a9737e2413780365bfe060040ed', 'request_id': 'req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:22.987361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdf1a9737e2413780365bfe060040ed', 'request_id': 'req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.004099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] The token cache is being invalidate because project 2cdf1a9737e2413780365bfe060040ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:23.004393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.005303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.007171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1212/2443] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:22 2022] DELETE /identity/v3/projects/2cdf1a9737e2413780365bfe060040ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:23.016294 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.028390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164fac-2a91-4fcb-b240-02abf8664a67 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.095466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.096208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.096587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.096920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] PATH_INFO: `/v3/users/bff13aa1d0ea47eeafe0a18f4c59ae06` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.098267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff13aa1d0ea47eeafe0a18f4c59ae06)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.100302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.128359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:23.150890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff13aa1d0ea47eeafe0a18f4c59ae06'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.158223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff13aa1d0ea47eeafe0a18f4c59ae06'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.158924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff13aa1d0ea47eeafe0a18f4c59ae06'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.167595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff13aa1d0ea47eeafe0a18f4c59ae06'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.182358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-19ff2331-8f54-47fa-a594-d7dce66025c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff13aa1d0ea47eeafe0a18f4c59ae06'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.189330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1232/2444] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:23 2022] DELETE /identity/v3/users/bff13aa1d0ea47eeafe0a18f4c59ae06 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:23.217944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.219581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.233096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf61ca0-fe8f-464b-b44d-7af6ddf54a34 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.299693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.300368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.300643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.300913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] PATH_INFO: `/v3/projects/f0c48fac349c411c9ee44bd41c79773f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.302068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c48fac349c411c9ee44bd41c79773f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.304049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.306430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:23.354668 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c48fac349c411c9ee44bd41c79773f', 'request_id': 'req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.361721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c48fac349c411c9ee44bd41c79773f', 'request_id': 'req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.367742 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c48fac349c411c9ee44bd41c79773f', 'request_id': 'req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.382996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] The token cache is being invalidate because project f0c48fac349c411c9ee44bd41c79773f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:23.383315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.383951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b0ee294b-3294-4e29-a796-ff44e5d3a5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.385501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1213/2445] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:23 2022] DELETE /identity/v3/projects/f0c48fac349c411c9ee44bd41c79773f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:23.391875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.392369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.392467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.412449 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:23.413663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.475374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1233/2446] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:23.484902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0508c-00dc-44d5-b25e-876c8fe3791e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.485188 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0508c-00dc-44d5-b25e-876c8fe3791e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.485460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0508c-00dc-44d5-b25e-876c8fe3791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.506984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.508579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.510427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-17a0508c-00dc-44d5-b25e-876c8fe3791e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:23.511736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-17a0508c-00dc-44d5-b25e-876c8fe3791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.521688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1214/2447] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:23.524765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299430f3-a606-4012-904c-376d46f2e2eb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.525921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0508c-00dc-44d5-b25e-876c8fe3791e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.530039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.530695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.531001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.531276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] PATH_INFO: `/v3/projects/d377177cddc1477691e82cafbaa97033` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.532487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d377177cddc1477691e82cafbaa97033)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.534586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.535914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0508c-00dc-44d5-b25e-876c8fe3791e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.542015 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.542756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.543118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.543221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.543963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:23.544346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.545981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.559370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1215/2448] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:23.567002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.579834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0b178-cd6e-4489-833b-d2c587cdd941 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.585048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.585598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.585881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.586154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.586818 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.588752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.598527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd377177cddc1477691e82cafbaa97033', 'request_id': 'req-459e4bbb-5917-4898-b974-ff4157709ea5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.617096 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd377177cddc1477691e82cafbaa97033', 'request_id': 'req-459e4bbb-5917-4898-b974-ff4157709ea5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.618485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1216/2449] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:23.623401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.625353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd377177cddc1477691e82cafbaa97033', 'request_id': 'req-459e4bbb-5917-4898-b974-ff4157709ea5'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.639780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] The token cache is being invalidate because project d377177cddc1477691e82cafbaa97033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:23.640199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.640890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-459e4bbb-5917-4898-b974-ff4157709ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:23.643122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1234/2450] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:23 2022] DELETE /identity/v3/projects/d377177cddc1477691e82cafbaa97033 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:23.647417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ed53-987c-4967-b028-19619fc37d3d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.647699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ed53-987c-4967-b028-19619fc37d3d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.647972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ed53-987c-4967-b028-19619fc37d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.667937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a9d4ed53-987c-4967-b028-19619fc37d3d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:23.669742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a9d4ed53-987c-4967-b028-19619fc37d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.688752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de434552-a183-487d-b7a2-3ed18b302b20 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.690517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:23.695348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.695981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.696917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.697203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.697873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.699972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.722049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1217/2451] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:23.726092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.727809 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.734492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1235/2452] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:23.740257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6cd7e-c227-4ea5-9957-7281616aaa18 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.743205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6afb2-b628-42b4-b3b0-8d9964cada60 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.743502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6afb2-b628-42b4-b3b0-8d9964cada60 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.743780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6afb2-b628-42b4-b3b0-8d9964cada60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.745041 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.745653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.745932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.746203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.747477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.749075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.764236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1218/2453] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:23.764437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3df6afb2-b628-42b4-b3b0-8d9964cada60 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:23.765044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3df6afb2-b628-42b4-b3b0-8d9964cada60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.765356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.773545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1236/2454] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:23.775629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a48c3-0466-4f14-8e69-2c8b4d5318fe admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.777414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6afb2-b628-42b4-b3b0-8d9964cada60 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.780885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.781613 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.781894 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.782167 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.782848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.784459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.786488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6afb2-b628-42b4-b3b0-8d9964cada60 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.791198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.791799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.792082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.792354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.793037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:23.793343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.794985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.798635 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1219/2455] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:23.799774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.808099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1237/2456] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:43:23.809344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54050988-e433-4c6a-a594-d19889781620 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.812726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.814678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d2754-1338-45a1-a529-ba98340f6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.815363 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2754-1338-45a1-a529-ba98340f6220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.815638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2754-1338-45a1-a529-ba98340f6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.815934 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2754-1338-45a1-a529-ba98340f6220 admin admin] PATH_INFO: `/v3/projects/51843e3bc3de4af29e76e529255eebde/users/505cbc8338a2474d8a2545abb28afa56/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.830823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2c910-aa98-434f-b2f1-4daa004d2eb4 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.831191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d2754-1338-45a1-a529-ba98340f6220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51843e3bc3de4af29e76e529255eebde, user_id=505cbc8338a2474d8a2545abb28afa56, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.833824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d2754-1338-45a1-a529-ba98340f6220 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.836000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:23.836520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.837123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.837407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.837669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.838317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.840207 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.850247 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1220/2457] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:23 2022] PUT /identity/v3/projects/51843e3bc3de4af29e76e529255eebde/users/505cbc8338a2474d8a2545abb28afa56/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:23.855558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.855858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.856129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.870471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1238/2458] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:23.875213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.877310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:23.878537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.937907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf06b-ba1e-4407-af01-22146f3d4f4f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.941301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1221/2459] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:23.942597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.943253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.943539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.943824 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.944533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.946480 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:23.951871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.953225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:23.969124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1239/2460] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:23 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:23.973130 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:23.983200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd7223-da8d-4e9c-b68d-8c7b65f1d06c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:23.987833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:23.988419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:23.988701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:23.988967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:23.989642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:23.991250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.001759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1240/2461] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:24.005275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.011588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62399-ea3c-4f84-841c-4239995ccff6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.015471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f055183-1dde-45e8-a50e-80a23e182d79 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.016338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557a2ef-30d2-4da0-944e-9323a3f58f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.016910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a2ef-30d2-4da0-944e-9323a3f58f57 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.017193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a2ef-30d2-4da0-944e-9323a3f58f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.017466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a2ef-30d2-4da0-944e-9323a3f58f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.020371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.020955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.021231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.021502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.022168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.023793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.026542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557a2ef-30d2-4da0-944e-9323a3f58f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.028006 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557a2ef-30d2-4da0-944e-9323a3f58f57 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.035593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1241/2462] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:24.039116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1222/2463] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:24.039850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.050442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46772cc-b00c-4cd4-bc79-9abf56bdc2e0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.055227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.055961 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.056268 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.056651 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] PATH_INFO: `/v3/projects/705cb1ff66854d95b78afd11aa3bd10b/users/7d923640f4e14e4b9797baacd32c2f2c/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.081997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] RBAC: Authorizing `identity:create_grant(project_id=705cb1ff66854d95b78afd11aa3bd10b, user_id=7d923640f4e14e4b9797baacd32c2f2c, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.084654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.098782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1242/2464] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:24 2022] PUT /identity/v3/projects/705cb1ff66854d95b78afd11aa3bd10b/users/7d923640f4e14e4b9797baacd32c2f2c/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:24.110312 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffda46-6f12-40f5-b792-0ee409b179a1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.110596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffda46-6f12-40f5-b792-0ee409b179a1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.110874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffda46-6f12-40f5-b792-0ee409b179a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.141365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a7ffda46-6f12-40f5-b792-0ee409b179a1 None None] MFA Rules not processed for user `7d923640f4e14e4b9797baacd32c2f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:24.142603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a7ffda46-6f12-40f5-b792-0ee409b179a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:24.214273 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1223/2465] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:24.219220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.253110 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:24.289074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6902af-6b63-41ce-bc12-16091d25654b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.294238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.294987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.295250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.295520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.296217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.298176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.329846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1243/2466] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:24 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:24.331449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffda46-6f12-40f5-b792-0ee409b179a1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.343350 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffda46-6f12-40f5-b792-0ee409b179a1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.367741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:24.403576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.404205 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.404479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.404751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.405413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.407394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.428469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1224/2467] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:24 2022] POST /identity/v3/users => generated 310 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:24.435663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.449807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff565c-ec35-4af9-9547-6f3169b58241 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.455782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.456535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.456882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.457250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.458016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.459724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.471901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1244/2468] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:24.476298 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.489875 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83193357-f7c7-4836-8c9b-ab766550bc2c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.494777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.495741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.496096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.496468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] PATH_INFO: `/v3/projects/5261837efa4848c884acf4f97fcd54df/users/c60db9b538b04c46bd52f9fa391dbdca/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.513731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5261837efa4848c884acf4f97fcd54df, user_id=c60db9b538b04c46bd52f9fa391dbdca, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.516683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.530017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1225/2469] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:24 2022] PUT /identity/v3/projects/5261837efa4848c884acf4f97fcd54df/users/c60db9b538b04c46bd52f9fa391dbdca/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:24.534395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.544460 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5b1c-ab10-43dd-ba8c-1a18b6031448 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.605173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c54d-1e5e-413a-8dbd-bdd19adee85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.605765 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c54d-1e5e-413a-8dbd-bdd19adee85e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.605990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c54d-1e5e-413a-8dbd-bdd19adee85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.606436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c54d-1e5e-413a-8dbd-bdd19adee85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.607144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c54d-1e5e-413a-8dbd-bdd19adee85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.608930 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c54d-1e5e-413a-8dbd-bdd19adee85e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.624343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1245/2470] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:24.628000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.649031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9426f5-29de-4d94-99be-df8a3c9856ec admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.657891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.659365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.659656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.660364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] PATH_INFO: `/v3/projects/5261837efa4848c884acf4f97fcd54df/users/c60db9b538b04c46bd52f9fa391dbdca/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.663728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5261837efa4848c884acf4f97fcd54df, user_id=c60db9b538b04c46bd52f9fa391dbdca, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.667305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.679579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1226/2471] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:24 2022] PUT /identity/v3/projects/5261837efa4848c884acf4f97fcd54df/users/c60db9b538b04c46bd52f9fa391dbdca/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:24.690763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1f784-ba91-453a-b0b7-57f3609a113c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.691328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1f784-ba91-453a-b0b7-57f3609a113c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.691598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1f784-ba91-453a-b0b7-57f3609a113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.722828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6df1f784-ba91-453a-b0b7-57f3609a113c None None] MFA Rules not processed for user `c60db9b538b04c46bd52f9fa391dbdca`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:24.723865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6df1f784-ba91-453a-b0b7-57f3609a113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:24.799309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1246/2472] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:24.810241 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:24.812181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:24.873618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4b94-a783-447e-b2a3-13b6938e9b5d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:24.877257 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:24.877886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.878169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.878442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:24.887716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:24.889587 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:24.899916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1227/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:24 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:24.995324 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd1c2d-f9e4-49c3-b32f-8c686d97d611 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:24.995697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd1c2d-f9e4-49c3-b32f-8c686d97d611 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:24.996045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd1c2d-f9e4-49c3-b32f-8c686d97d611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.027536 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ffdd1c2d-f9e4-49c3-b32f-8c686d97d611 None None] MFA Rules not processed for user `505cbc8338a2474d8a2545abb28afa56`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:25.029980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ffdd1c2d-f9e4-49c3-b32f-8c686d97d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:25.046464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:25.080614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:25.091358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa798-8a79-4555-9519-4c3691012169 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:25.095782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:25.096618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:25.097005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:25.097375 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.117573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1247/2474] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:25.118609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd1c2d-f9e4-49c3-b32f-8c686d97d611 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:25.180163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:25.181619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:25.192382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1228/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:25.198411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd1c2d-f9e4-49c3-b32f-8c686d97d611 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:25.203667 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:25.204300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:25.204636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:25.205057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.205773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:25.207733 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:25.237604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1248/2476] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:25 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:25.242091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:25.254271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e22f4-a556-47f5-bcd6-a29cfd5a7701 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:25.273569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:25.317776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:25.318397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:25.318676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:25.318963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.319614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:25.321829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:25.345723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1229/2477] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:25 2022] POST /identity/v3/users => generated 308 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:25.349776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:25.361593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5485c6-5d14-44af-9d69-1f3c90b65c8a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:25.366860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:25.367494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:25.367825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:25.368044 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.368728 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:25.370417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:25.381280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1249/2478] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:25.385577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:25.407485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8c2d-33be-4d76-b72c-cef5018b8c24 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:25.412886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:25.413577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:25.413955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:25.414231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] PATH_INFO: `/v3/projects/b4463df5cb1047cabc8b84b42a2fac2e/users/3e0829a4962e4a538c8e92844ff734ec/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.430369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4463df5cb1047cabc8b84b42a2fac2e, user_id=3e0829a4962e4a538c8e92844ff734ec, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:25.433130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:25.458412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1230/2479] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:25 2022] PUT /identity/v3/projects/b4463df5cb1047cabc8b84b42a2fac2e/users/3e0829a4962e4a538c8e92844ff734ec/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:25.462243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:25.475988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658dee3-2712-4df5-9195-ea78ee407a23 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:25.540603 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf579b8-5761-4f6b-93f2-0429ca131010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:25.541222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf579b8-5761-4f6b-93f2-0429ca131010 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:25.541498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf579b8-5761-4f6b-93f2-0429ca131010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:25.541768 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf579b8-5761-4f6b-93f2-0429ca131010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.542456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf579b8-5761-4f6b-93f2-0429ca131010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:25.544641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf579b8-5761-4f6b-93f2-0429ca131010 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:25.555234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1250/2480] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:25.560463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:25.575936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403acc4-570c-4340-90b0-769792a64012 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:25.581351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca925dee-a1ca-4fb9-ba29-16133d5ad2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:25.582031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925dee-a1ca-4fb9-ba29-16133d5ad2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:25.582331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925dee-a1ca-4fb9-ba29-16133d5ad2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:25.582592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925dee-a1ca-4fb9-ba29-16133d5ad2dc admin admin] PATH_INFO: `/v3/projects/b4463df5cb1047cabc8b84b42a2fac2e/users/3e0829a4962e4a538c8e92844ff734ec/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:25.584631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca925dee-a1ca-4fb9-ba29-16133d5ad2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4463df5cb1047cabc8b84b42a2fac2e, user_id=3e0829a4962e4a538c8e92844ff734ec, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:25.587373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca925dee-a1ca-4fb9-ba29-16133d5ad2dc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:25.599151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1231/2481] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:25 2022] PUT /identity/v3/projects/b4463df5cb1047cabc8b84b42a2fac2e/users/3e0829a4962e4a538c8e92844ff734ec/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:26.501079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:26.501648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:26.501648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:26.533376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] MFA Rules not processed for user `3e0829a4962e4a538c8e92844ff734ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:26.534632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:26.547423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:26.614091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1251/2482] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:27.779372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250d3cf-0ecd-4329-8260-4ff011d0d2b6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:27.779938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250d3cf-0ecd-4329-8260-4ff011d0d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:27.779938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250d3cf-0ecd-4329-8260-4ff011d0d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:27.799666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7250d3cf-0ecd-4329-8260-4ff011d0d2b6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:27.800884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7250d3cf-0ecd-4329-8260-4ff011d0d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:27.869781 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1232/2483] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:27.891858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:27.895915 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:27.990805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f9a0-df6a-45df-9f41-8764ce80d696 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:27.998049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:27.999043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:27.999393 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:27.999840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:28.009027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:28.010829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:28.023341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1252/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:28.078560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250d3cf-0ecd-4329-8260-4ff011d0d2b6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:28.096394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250d3cf-0ecd-4329-8260-4ff011d0d2b6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:28.103088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:28.103935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:28.104280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:28.104618 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] PATH_INFO: `/v3/users/505cbc8338a2474d8a2545abb28afa56` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:28.105845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=505cbc8338a2474d8a2545abb28afa56)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:28.108454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:28.163151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505cbc8338a2474d8a2545abb28afa56'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.163151 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505cbc8338a2474d8a2545abb28afa56'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.172981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505cbc8338a2474d8a2545abb28afa56'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.181835 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505cbc8338a2474d8a2545abb28afa56'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.182517 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505cbc8338a2474d8a2545abb28afa56'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.187744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:28.203890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1233/2485] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:28 2022] DELETE /identity/v3/users/505cbc8338a2474d8a2545abb28afa56 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:28.409275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:28.420835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe2aa6-84f1-407e-8ded-73189582beca service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:28.505607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:28.506290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:28.506670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:28.506857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] PATH_INFO: `/v3/projects/51843e3bc3de4af29e76e529255eebde` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:28.508027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=51843e3bc3de4af29e76e529255eebde)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:28.509951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:28.549946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:28.560369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51843e3bc3de4af29e76e529255eebde', 'request_id': 'req-704903dc-d3c2-4711-84ba-fb31a02ee88a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.566751 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51843e3bc3de4af29e76e529255eebde', 'request_id': 'req-704903dc-d3c2-4711-84ba-fb31a02ee88a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.574172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51843e3bc3de4af29e76e529255eebde', 'request_id': 'req-704903dc-d3c2-4711-84ba-fb31a02ee88a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.586666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] The token cache is being invalidate because project 51843e3bc3de4af29e76e529255eebde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:28.586980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.587630 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.589106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1253/2486] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:28 2022] DELETE /identity/v3/projects/51843e3bc3de4af29e76e529255eebde => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:28.593243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:28.594704 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:28.608738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e97788-4112-4112-aed2-d4adf44ac6bb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:28.665656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:28.666292 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:28.666569 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:28.666838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] PATH_INFO: `/v3/users/3e0829a4962e4a538c8e92844ff734ec` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:28.668009 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0829a4962e4a538c8e92844ff734ec)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:28.670152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:28.717836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0829a4962e4a538c8e92844ff734ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.718475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0829a4962e4a538c8e92844ff734ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.726521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0829a4962e4a538c8e92844ff734ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.733484 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0829a4962e4a538c8e92844ff734ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.734106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-18ae67c7-03fc-4d43-abcf-f59f4192a722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0829a4962e4a538c8e92844ff734ec'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:28.751475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1234/2487] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:28 2022] DELETE /identity/v3/users/3e0829a4962e4a538c8e92844ff734ec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:28.931037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:28.932513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:28.947912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704903dc-d3c2-4711-84ba-fb31a02ee88a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.006716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.007398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.007677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.007956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] PATH_INFO: `/v3/projects/b4463df5cb1047cabc8b84b42a2fac2e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.009098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4463df5cb1047cabc8b84b42a2fac2e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.011039 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.057749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4463df5cb1047cabc8b84b42a2fac2e', 'request_id': 'req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:29.064523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4463df5cb1047cabc8b84b42a2fac2e', 'request_id': 'req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:29.073907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4463df5cb1047cabc8b84b42a2fac2e', 'request_id': 'req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:29.087734 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] The token cache is being invalidate because project b4463df5cb1047cabc8b84b42a2fac2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:29.088021 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:29.088684 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-fe19c7a9-9d87-4cf7-89fa-c7ca1222e4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:29.090196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1254/2488] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:28 2022] DELETE /identity/v3/projects/b4463df5cb1047cabc8b84b42a2fac2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:29.095385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90303-d4ce-4d6a-9bce-7346caa0cb23 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.095907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90303-d4ce-4d6a-9bce-7346caa0cb23 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.096024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90303-d4ce-4d6a-9bce-7346caa0cb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.115796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2cf90303-d4ce-4d6a-9bce-7346caa0cb23 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:29.116984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2cf90303-d4ce-4d6a-9bce-7346caa0cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:29.175610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1235/2489] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:29.183429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1f44-a3d8-49fa-ae41-b47e4d7ad22a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.183714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1f44-a3d8-49fa-ae41-b47e4d7ad22a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.184010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1f44-a3d8-49fa-ae41-b47e4d7ad22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.204285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a17a1f44-a3d8-49fa-ae41-b47e4d7ad22a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:29.205537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a17a1f44-a3d8-49fa-ae41-b47e4d7ad22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:29.213375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1255/2490] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:29.217962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90303-d4ce-4d6a-9bce-7346caa0cb23 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.225359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:29.229952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90303-d4ce-4d6a-9bce-7346caa0cb23 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.236740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.237395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.237845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.238278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.239059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:29.239557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.241256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.253717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1236/2491] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:29.258083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1f44-a3d8-49fa-ae41-b47e4d7ad22a None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.268217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1f44-a3d8-49fa-ae41-b47e4d7ad22a None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.272754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.273347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.273621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.273888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.274533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.276462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.303984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1256/2492] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:29 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:29.308143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.318850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee6634-fa0c-4c49-b237-9379483b698c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.379930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.380566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.380845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.381126 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.381786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.383743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.406523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1237/2493] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:29 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:29.410714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.422454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ca1ae-dc95-4830-8569-a73f641532b6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.428707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.429639 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.429923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.430199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.431030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.432650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.446137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1257/2494] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:29.450049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.460576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c084f-f5de-4331-890a-0739f5067c16 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.465343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c7301-7d88-43d0-a639-0bb1a61c8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.466224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7301-7d88-43d0-a639-0bb1a61c8436 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.466588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7301-7d88-43d0-a639-0bb1a61c8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.466866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7301-7d88-43d0-a639-0bb1a61c8436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.467757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c7301-7d88-43d0-a639-0bb1a61c8436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.469727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c7301-7d88-43d0-a639-0bb1a61c8436 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.481646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1238/2495] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:29.485808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.497412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cdcab-3b31-46aa-b273-26ccad490a8f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.504496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.505195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.505480 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.505773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] PATH_INFO: `/v3/projects/c858727fa6ac4c14b39ec0973b3b83c9/users/2b2376cc4ce44edb8790b90a32679825/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.520414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:29.524442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c858727fa6ac4c14b39ec0973b3b83c9, user_id=2b2376cc4ce44edb8790b90a32679825, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.527841 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.545778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1258/2496] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:29 2022] PUT /identity/v3/projects/c858727fa6ac4c14b39ec0973b3b83c9/users/2b2376cc4ce44edb8790b90a32679825/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:29.556234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a970d-2acf-4bfa-9c74-41229230f123 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.556520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a970d-2acf-4bfa-9c74-41229230f123 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.556790 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a970d-2acf-4bfa-9c74-41229230f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.585062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-964a970d-2acf-4bfa-9c74-41229230f123 None None] MFA Rules not processed for user `2b2376cc4ce44edb8790b90a32679825`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:29.586320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-964a970d-2acf-4bfa-9c74-41229230f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:29.655566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1239/2497] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:29.660026 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.722494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43ac35-cd6c-46e8-b0dc-38bc9280627e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.727237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.727854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.728135 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.728407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.729103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.731035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.758062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1259/2498] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:29 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:29.762026 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a970d-2acf-4bfa-9c74-41229230f123 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.774324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a970d-2acf-4bfa-9c74-41229230f123 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.830221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.830842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.831153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.831434 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.832098 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.834028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.842394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:29.857179 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1240/2499] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:29 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:29.861794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.872063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3989e14-08b0-4bf4-9b50-9d7ba192e944 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.877045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.877686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.877974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.878252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.878957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.880565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.891872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1260/2500] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:29.896088 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.906725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8c55-37f7-4c97-9e27-5c7d7215c656 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:29.911411 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:29.912061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:29.912338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:29.912610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] PATH_INFO: `/v3/projects/6d4f78855aab4c9bb2c1b3f2111dfd55/users/3f3d5a66f90549cf8887b15865b7ed10/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:29.928014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4f78855aab4c9bb2c1b3f2111dfd55, user_id=3f3d5a66f90549cf8887b15865b7ed10, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:29.930845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:29.945022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1241/2501] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:29 2022] PUT /identity/v3/projects/6d4f78855aab4c9bb2c1b3f2111dfd55/users/3f3d5a66f90549cf8887b15865b7ed10/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:29.949011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:29.959637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11a0eb-afb2-4574-ab05-a7ba35520966 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:30.016716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded56cb-7d7b-4912-a5bd-13180bff9255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:30.017331 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded56cb-7d7b-4912-a5bd-13180bff9255 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:30.017617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded56cb-7d7b-4912-a5bd-13180bff9255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:30.017894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded56cb-7d7b-4912-a5bd-13180bff9255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:30.018584 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded56cb-7d7b-4912-a5bd-13180bff9255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:30.020228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded56cb-7d7b-4912-a5bd-13180bff9255 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:30.030371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1261/2502] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:30.034466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:30.044898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708629f7-8274-4fbf-af43-d994dfedd207 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:30.049475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:30.050131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:30.050409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:30.050681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] PATH_INFO: `/v3/projects/6d4f78855aab4c9bb2c1b3f2111dfd55/users/3f3d5a66f90549cf8887b15865b7ed10/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:30.052667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4f78855aab4c9bb2c1b3f2111dfd55, user_id=3f3d5a66f90549cf8887b15865b7ed10, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:30.055349 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:30.065275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1242/2503] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:30 2022] PUT /identity/v3/projects/6d4f78855aab4c9bb2c1b3f2111dfd55/users/3f3d5a66f90549cf8887b15865b7ed10/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:30.077513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314ca0-cceb-4549-9778-7c57932ba3cd None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:30.077800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314ca0-cceb-4549-9778-7c57932ba3cd None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:30.078074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314ca0-cceb-4549-9778-7c57932ba3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:30.105897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-38314ca0-cceb-4549-9778-7c57932ba3cd None None] MFA Rules not processed for user `3f3d5a66f90549cf8887b15865b7ed10`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:30.107278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-38314ca0-cceb-4549-9778-7c57932ba3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:30.154412 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:30.176745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1262/2504] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:30.188201 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:30.189940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:30.251735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d77fa2-dabe-475c-92c4-b07e05bcfff9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:30.255591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:30.256210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:30.256503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:30.256776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:30.266814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:30.268380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:30.278539 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1243/2505] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:30.379450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38314ca0-cceb-4549-9778-7c57932ba3cd None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:30.388887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38314ca0-cceb-4549-9778-7c57932ba3cd None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:30.392747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac59a8-c1d4-4658-9aab-2a3a8f2fd4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:30.393359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac59a8-c1d4-4658-9aab-2a3a8f2fd4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:30.393637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac59a8-c1d4-4658-9aab-2a3a8f2fd4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:30.393909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac59a8-c1d4-4658-9aab-2a3a8f2fd4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:30.452235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac59a8-c1d4-4658-9aab-2a3a8f2fd4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:30.453692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac59a8-c1d4-4658-9aab-2a3a8f2fd4e7 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:30.462554 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1263/2506] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:30.647924 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:30.651036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:30.738625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef259-46ed-4656-911c-2423b3308af4 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:30.745352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:30.746369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:30.747584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:30.748061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] PATH_INFO: `/v3/users/7d923640f4e14e4b9797baacd32c2f2c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:30.749526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d923640f4e14e4b9797baacd32c2f2c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:30.751567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:30.818409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d923640f4e14e4b9797baacd32c2f2c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:30.819213 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d923640f4e14e4b9797baacd32c2f2c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:30.828948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d923640f4e14e4b9797baacd32c2f2c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:30.832807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:30.851269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d923640f4e14e4b9797baacd32c2f2c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:30.855591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d923640f4e14e4b9797baacd32c2f2c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:30.882211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1244/2507] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:30 2022] DELETE /identity/v3/users/7d923640f4e14e4b9797baacd32c2f2c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:30.886556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5048-b45b-4ed2-90d5-5e1d556f0c63 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:30.886840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5048-b45b-4ed2-90d5-5e1d556f0c63 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:30.887143 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5048-b45b-4ed2-90d5-5e1d556f0c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:30.906125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-050d5048-b45b-4ed2-90d5-5e1d556f0c63 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:30.907361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-050d5048-b45b-4ed2-90d5-5e1d556f0c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:30.965474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1264/2508] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:30.975334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:30.976755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:31.035884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10c974-f9ad-42b8-9a22-6a077f901750 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:31.039643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:31.040408 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:31.040784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:31.041156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:31.051675 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:31.053119 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:31.064096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1245/2509] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:31.071623 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:31.071954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:31.072231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:31.094331 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:31.095598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:31.104300 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1265/2510] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:31.119609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:31.121203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:31.202104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a76b-b621-4161-b580-24754ca7b44b service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:31.208058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:31.208692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:31.208978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:31.209253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:31.219227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:31.224495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:31.236743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1246/2511] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:31.368401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:31.370231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:31.384850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03cb3-9731-4dca-a455-ff28774fe0b7 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:31.391834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:31.392496 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:31.392779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:31.393049 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] PATH_INFO: `/v3/projects/705cb1ff66854d95b78afd11aa3bd10b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:31.394215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=705cb1ff66854d95b78afd11aa3bd10b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:31.396181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:31.444457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705cb1ff66854d95b78afd11aa3bd10b', 'request_id': 'req-8506ce9e-5016-4296-810d-58cbb4cdf5ee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.450531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705cb1ff66854d95b78afd11aa3bd10b', 'request_id': 'req-8506ce9e-5016-4296-810d-58cbb4cdf5ee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.457910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705cb1ff66854d95b78afd11aa3bd10b', 'request_id': 'req-8506ce9e-5016-4296-810d-58cbb4cdf5ee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.469577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] The token cache is being invalidate because project 705cb1ff66854d95b78afd11aa3bd10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:31.469868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.470486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.472167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1266/2512] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:31 2022] DELETE /identity/v3/projects/705cb1ff66854d95b78afd11aa3bd10b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:31.476030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:31.487405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da70b3-e5bc-4d15-8a0d-b3f22502479e service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:31.543286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:31.544287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:31.544573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:31.544852 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] PATH_INFO: `/v3/users/c60db9b538b04c46bd52f9fa391dbdca` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:31.546002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60db9b538b04c46bd52f9fa391dbdca)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:31.547976 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:31.550182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:31.595080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60db9b538b04c46bd52f9fa391dbdca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.595725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60db9b538b04c46bd52f9fa391dbdca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.603639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60db9b538b04c46bd52f9fa391dbdca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.611198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60db9b538b04c46bd52f9fa391dbdca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.611844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2e9f1ab-33ac-41b2-867f-b9e2f612d598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60db9b538b04c46bd52f9fa391dbdca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:31.629890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1247/2513] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:31 2022] DELETE /identity/v3/users/c60db9b538b04c46bd52f9fa391dbdca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:31.926745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:31.928181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:31.941719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:31.950717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ce9e-5016-4296-810d-58cbb4cdf5ee admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.015317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.016226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.016506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.016794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] PATH_INFO: `/v3/projects/5261837efa4848c884acf4f97fcd54df` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.018062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5261837efa4848c884acf4f97fcd54df)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.020010 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.079563 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5261837efa4848c884acf4f97fcd54df', 'request_id': 'req-56b16576-718c-4954-bd60-fcc3593cf727'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:32.086737 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5261837efa4848c884acf4f97fcd54df', 'request_id': 'req-56b16576-718c-4954-bd60-fcc3593cf727'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:32.097773 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5261837efa4848c884acf4f97fcd54df', 'request_id': 'req-56b16576-718c-4954-bd60-fcc3593cf727'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:32.109579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] The token cache is being invalidate because project 5261837efa4848c884acf4f97fcd54df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:32.109871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:32.110521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-56b16576-718c-4954-bd60-fcc3593cf727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:32.112249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1267/2514] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:31 2022] DELETE /identity/v3/projects/5261837efa4848c884acf4f97fcd54df => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:32.117207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fb84-4136-4abd-b998-0c7fe8435584 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.117563 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fb84-4136-4abd-b998-0c7fe8435584 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.117913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fb84-4136-4abd-b998-0c7fe8435584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.139651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2b28fb84-4136-4abd-b998-0c7fe8435584 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:32.141203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2b28fb84-4136-4abd-b998-0c7fe8435584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:32.205340 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1248/2515] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:32.216610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964f985-7c17-4558-9b7c-a437643c68da None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.216902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964f985-7c17-4558-9b7c-a437643c68da None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.217177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964f985-7c17-4558-9b7c-a437643c68da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.238100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2964f985-7c17-4558-9b7c-a437643c68da None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:32.239403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2964f985-7c17-4558-9b7c-a437643c68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:32.248121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1268/2516] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:32.252606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28fb84-4136-4abd-b998-0c7fe8435584 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.263271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28fb84-4136-4abd-b998-0c7fe8435584 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.268297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.268910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.269191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.269465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.270160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:32.270464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.272103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.284463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1249/2517] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:32.288724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964f985-7c17-4558-9b7c-a437643c68da None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.298032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964f985-7c17-4558-9b7c-a437643c68da None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.302759 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.303404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.303692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.303964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.304631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.306529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.333437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1269/2518] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:32 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:32.337207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.348050 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba59b71-52a8-4ba0-88b9-f2c6fb7eb1c2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.403521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.404143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.404427 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.404701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.405368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.407361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.423901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:32.433431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1250/2519] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:32 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:32.435972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.446428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacfd29-88ee-4786-aa80-beb1e1401ef2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.451288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.451906 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.452190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.452467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.453216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.454834 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.464740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1270/2520] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:32.468658 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.479028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb6256-bd00-47c0-8f1b-7e6d44aaa4bf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.485325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f29647-5752-4627-b146-c2963159cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.486029 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f29647-5752-4627-b146-c2963159cba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.486316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f29647-5752-4627-b146-c2963159cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.486615 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f29647-5752-4627-b146-c2963159cba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.487364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f29647-5752-4627-b146-c2963159cba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.489012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f29647-5752-4627-b146-c2963159cba6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.502394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1251/2521] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:32.506787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.519776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9bb94-6cfa-4ee8-bac2-8d610ca96da2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.524387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.525057 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.525360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.525636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] PATH_INFO: `/v3/projects/101883c212534fda9fc657b21aa6956a/users/a0cb5a9e27824acb8cbbbcdcce26dd38/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.541916 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] RBAC: Authorizing `identity:create_grant(project_id=101883c212534fda9fc657b21aa6956a, user_id=a0cb5a9e27824acb8cbbbcdcce26dd38, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.545392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.557991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1271/2522] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:32 2022] PUT /identity/v3/projects/101883c212534fda9fc657b21aa6956a/users/a0cb5a9e27824acb8cbbbcdcce26dd38/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:32.568822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea527c8-632f-4a9e-bc5b-5b098507d380 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.569104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea527c8-632f-4a9e-bc5b-5b098507d380 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.569383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea527c8-632f-4a9e-bc5b-5b098507d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.597509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fea527c8-632f-4a9e-bc5b-5b098507d380 None None] MFA Rules not processed for user `a0cb5a9e27824acb8cbbbcdcce26dd38`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:32.598711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fea527c8-632f-4a9e-bc5b-5b098507d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:32.661941 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1252/2523] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:32.666544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.824535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:32.860511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01455e02-71ed-4341-88dd-1bfbb21b090c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.865174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.865790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.866064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.866332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.867046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.868923 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:32.896720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1272/2524] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:32 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:32.900732 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea527c8-632f-4a9e-bc5b-5b098507d380 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:32.912964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea527c8-632f-4a9e-bc5b-5b098507d380 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:32.979997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:32.980655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:32.981450 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:32.981726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:32.982540 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:32.984475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.005692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1253/2525] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:32 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:33.009674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.020795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c620a-424b-4670-b3d5-a4adc4124dab admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.027028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.027182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.027482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.028374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.029976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.031743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.043102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1273/2526] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:33.047825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.058282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a462f72-489f-4eef-8682-a5513872083a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.063280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.063973 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.064245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.064519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] PATH_INFO: `/v3/projects/74dac68b0b7941ba9504446a3930f0e3/users/ce6ca872b9d5400ea8e06d9488f6c600/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.094325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dac68b0b7941ba9504446a3930f0e3, user_id=ce6ca872b9d5400ea8e06d9488f6c600, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.097055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.109719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.111665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:33.113576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1254/2527] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:33 2022] PUT /identity/v3/projects/74dac68b0b7941ba9504446a3930f0e3/users/ce6ca872b9d5400ea8e06d9488f6c600/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:33.117588 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.126299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3071-d1c6-493b-9106-7756b4d89463 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.166058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:33.191955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.192604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.192886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.193160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] PATH_INFO: `/v3/users/2b2376cc4ce44edb8790b90a32679825` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.193488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94576-a625-4d4f-8f7f-35a2a41c984e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.194342 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2376cc4ce44edb8790b90a32679825)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.196289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.199114 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.200614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.201049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.201331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.202037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.204115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.219649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1255/2528] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:33.221912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.236332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b3acc-5b96-418e-a092-92f232361616 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.244966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068e82c-2a8d-49d2-a0b4-4ee7fbf87bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.245655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068e82c-2a8d-49d2-a0b4-4ee7fbf87bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.245936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068e82c-2a8d-49d2-a0b4-4ee7fbf87bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.246239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068e82c-2a8d-49d2-a0b4-4ee7fbf87bf3 admin admin] PATH_INFO: `/v3/projects/74dac68b0b7941ba9504446a3930f0e3/users/ce6ca872b9d5400ea8e06d9488f6c600/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.249059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068e82c-2a8d-49d2-a0b4-4ee7fbf87bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dac68b0b7941ba9504446a3930f0e3, user_id=ce6ca872b9d5400ea8e06d9488f6c600, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.251847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068e82c-2a8d-49d2-a0b4-4ee7fbf87bf3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.254117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2376cc4ce44edb8790b90a32679825'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.261861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2376cc4ce44edb8790b90a32679825'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.262851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2376cc4ce44edb8790b90a32679825'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.264424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1256/2529] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:33 2022] PUT /identity/v3/projects/74dac68b0b7941ba9504446a3930f0e3/users/ce6ca872b9d5400ea8e06d9488f6c600/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:33.274197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2376cc4ce44edb8790b90a32679825'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.279160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.279562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.279829 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.288542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-031c1dd6-5189-46ce-a223-6b40bc1ef39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2376cc4ce44edb8790b90a32679825'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.295406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1274/2530] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:33 2022] DELETE /identity/v3/users/2b2376cc4ce44edb8790b90a32679825 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:33.299629 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.299913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.300187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.309531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] MFA Rules not processed for user `ce6ca872b9d5400ea8e06d9488f6c600`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:33.310926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:33.318231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:33.319423 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:33.335779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:33.383416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1275/2531] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:33.389324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1257/2532] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:33.395925 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.397303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:33.400159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.401750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:33.466199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599941e-0efb-4b06-b54f-2e054caa1861 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.469982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.470603 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.470879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.471185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.472731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41da0-6b31-4441-bc71-9ebe6493fb39 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.476398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.477016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.477298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.477578 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.480263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.481734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.487027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.488494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.491842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1258/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:33.499003 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1276/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:33.791442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.793222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:33.808028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40652311-1861-4978-b54a-09e684b7ffc5 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.814752 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.815679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.816104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.816629 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] PATH_INFO: `/v3/projects/c858727fa6ac4c14b39ec0973b3b83c9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.818681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c858727fa6ac4c14b39ec0973b3b83c9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.823879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:33.877786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:33.880533 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c858727fa6ac4c14b39ec0973b3b83c9', 'request_id': 'req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.890131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c858727fa6ac4c14b39ec0973b3b83c9', 'request_id': 'req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.896601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c858727fa6ac4c14b39ec0973b3b83c9', 'request_id': 'req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.908729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] The token cache is being invalidate because project c858727fa6ac4c14b39ec0973b3b83c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:33.909018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.909656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:33.911156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1259/2535] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:33 2022] DELETE /identity/v3/projects/c858727fa6ac4c14b39ec0973b3b83c9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:33.915168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:33.928288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364527-6cbd-4a93-ae7e-223897f38778 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:33.990663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:33.991535 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:33.991864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:33.992200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] PATH_INFO: `/v3/users/3f3d5a66f90549cf8887b15865b7ed10` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:33.993489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3d5a66f90549cf8887b15865b7ed10)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:33.995515 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:34.052523 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3d5a66f90549cf8887b15865b7ed10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.066610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3d5a66f90549cf8887b15865b7ed10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.066610 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3d5a66f90549cf8887b15865b7ed10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.078655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3d5a66f90549cf8887b15865b7ed10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.085665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:34.086867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:34.088599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.103525 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211d71f-3a07-40b4-bee5-3f6f8cc1f343 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:34.108468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9ea19099-f2b2-4776-88a7-b8fc808298be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3d5a66f90549cf8887b15865b7ed10'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.109253 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:34.109890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.110186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.115274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] PATH_INFO: `/v3/users/a0cb5a9e27824acb8cbbbcdcce26dd38` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.115274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cb5a9e27824acb8cbbbcdcce26dd38)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:34.115274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:34.124261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1277/2536] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:33 2022] DELETE /identity/v3/users/3f3d5a66f90549cf8887b15865b7ed10 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:34.187913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cb5a9e27824acb8cbbbcdcce26dd38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.189005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cb5a9e27824acb8cbbbcdcce26dd38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.199456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cb5a9e27824acb8cbbbcdcce26dd38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.208866 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cb5a9e27824acb8cbbbcdcce26dd38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.209628 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d20114c9-41c9-4e0a-9589-6632855af23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cb5a9e27824acb8cbbbcdcce26dd38'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.235203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1260/2537] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:34 2022] DELETE /identity/v3/users/a0cb5a9e27824acb8cbbbcdcce26dd38 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:34.237693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.238210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.238557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.261161 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:34.263220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.312260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.312556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.312949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.336357 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1278/2538] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:34.340797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:34.342617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.349195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:34.350671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.351541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1261/2539] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:34.369155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:34.371113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.425401 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b51c0-d3b2-4838-a14c-3d435ccc5272 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:34.435798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:34.439702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.439702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.439702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.453298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:34.454819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:34.465117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1279/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:34.471740 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682df8a3-e74a-47d5-8b65-a652029515a0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:34.477930 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862eb6-9185-41a6-8757-a0f61a7c6c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:34.478641 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862eb6-9185-41a6-8757-a0f61a7c6c5c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.479023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862eb6-9185-41a6-8757-a0f61a7c6c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.479374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862eb6-9185-41a6-8757-a0f61a7c6c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.488844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862eb6-9185-41a6-8757-a0f61a7c6c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:34.490443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862eb6-9185-41a6-8757-a0f61a7c6c5c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:34.500928 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1262/2541] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:34.643453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:34.646163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.669448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d622f-edad-4afb-a162-652facd2a186 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:34.677650 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:34.678310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.678586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.678855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] PATH_INFO: `/v3/projects/6d4f78855aab4c9bb2c1b3f2111dfd55` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.680191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4f78855aab4c9bb2c1b3f2111dfd55)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:34.681949 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:34.739407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4f78855aab4c9bb2c1b3f2111dfd55', 'request_id': 'req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.745456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4f78855aab4c9bb2c1b3f2111dfd55', 'request_id': 'req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.753993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4f78855aab4c9bb2c1b3f2111dfd55', 'request_id': 'req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.765353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] The token cache is being invalidate because project 6d4f78855aab4c9bb2c1b3f2111dfd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:34.765640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.766543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-b4a2f208-bd06-4c0c-8d13-abc1d25a3763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:34.768546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1280/2542] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:34 2022] DELETE /identity/v3/projects/6d4f78855aab4c9bb2c1b3f2111dfd55 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:34.773461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f02ba-97c8-4b08-9b8b-e2b8fcb4121b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.773746 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f02ba-97c8-4b08-9b8b-e2b8fcb4121b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.774025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f02ba-97c8-4b08-9b8b-e2b8fcb4121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.795208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4a4f02ba-97c8-4b08-9b8b-e2b8fcb4121b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:34.796404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4a4f02ba-97c8-4b08-9b8b-e2b8fcb4121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.818822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:34.860981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1263/2543] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:34.870176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b72975-361b-48bf-9f5a-61a703a9d555 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.870522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b72975-361b-48bf-9f5a-61a703a9d555 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.870860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b72975-361b-48bf-9f5a-61a703a9d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.893857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-85b72975-361b-48bf-9f5a-61a703a9d555 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:34.895258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-85b72975-361b-48bf-9f5a-61a703a9d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:34.905360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1281/2544] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:34.909162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f02ba-97c8-4b08-9b8b-e2b8fcb4121b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:34.921549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f02ba-97c8-4b08-9b8b-e2b8fcb4121b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:34.927391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:34.928106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.928456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.928794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.929608 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:34.929979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:34.931805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:34.947173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1264/2545] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:43:34.950616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b72975-361b-48bf-9f5a-61a703a9d555 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:34.956914 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:34.962284 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b72975-361b-48bf-9f5a-61a703a9d555 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:34.973196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:34.973971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:34.974700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:34.974700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:34.975222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:34.977165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.010444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1282/2546] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:34 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:35.016235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.025258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.029774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977a43f-9461-44f9-bb8e-90dfbc7d192f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.031522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:35.105494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.106757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.107060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.107342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.107984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.110107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.123280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b421a0-e291-4305-a4bd-2da402ecfe32 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.128419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.129303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.129632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.129987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] PATH_INFO: `/v3/projects/101883c212534fda9fc657b21aa6956a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.131270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=101883c212534fda9fc657b21aa6956a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.133255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.139230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1265/2547] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:35 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:35.141185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.151647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5953ca2-7aef-49e1-ae70-52cb6709b267 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.156841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.157560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.157970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.158345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.159170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.161178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.174022 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1266/2548] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:35.178483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.190557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6724bba-6c45-4c8c-9022-c8a23c5ae49d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.191929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101883c212534fda9fc657b21aa6956a', 'request_id': 'req-d2d90739-9d6f-4e32-be81-463c47823aee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.198308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101883c212534fda9fc657b21aa6956a', 'request_id': 'req-d2d90739-9d6f-4e32-be81-463c47823aee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.209086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101883c212534fda9fc657b21aa6956a', 'request_id': 'req-d2d90739-9d6f-4e32-be81-463c47823aee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.228108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] The token cache is being invalidate because project 101883c212534fda9fc657b21aa6956a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:35.228395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.229424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.233432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1283/2549] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:35 2022] DELETE /identity/v3/projects/101883c212534fda9fc657b21aa6956a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:35.237469 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.240041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:35.304892 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.305564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.306478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.307033 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.307932 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.310135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.321294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1267/2550] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:35.326822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.329057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:35.336822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90739-9d6f-4e32-be81-463c47823aee admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.343322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.343914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f0eda-488c-431a-a59a-b9714478ad2b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.344082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.344251 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.344530 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] PATH_INFO: `/v3/users/ce6ca872b9d5400ea8e06d9488f6c600` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.345722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6ca872b9d5400ea8e06d9488f6c600)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.348358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.352758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ef8ae-075f-4802-bed2-123cdb15a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.353438 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ef8ae-075f-4802-bed2-123cdb15a495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.353715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ef8ae-075f-4802-bed2-123cdb15a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.354159 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ef8ae-075f-4802-bed2-123cdb15a495 admin admin] PATH_INFO: `/v3/projects/74c93466e357468681b7d4102ff702b8/users/b5b46cc501db4cf8872a4d90675fbd42/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.364144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:35.371981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ef8ae-075f-4802-bed2-123cdb15a495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c93466e357468681b7d4102ff702b8, user_id=b5b46cc501db4cf8872a4d90675fbd42, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.376907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ef8ae-075f-4802-bed2-123cdb15a495 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.392367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1268/2551] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:35 2022] PUT /identity/v3/projects/74c93466e357468681b7d4102ff702b8/users/b5b46cc501db4cf8872a4d90675fbd42/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:35.403424 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687902cf-dc41-4dba-8572-c8ecf18f9bf3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.403825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687902cf-dc41-4dba-8572-c8ecf18f9bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.403954 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6ca872b9d5400ea8e06d9488f6c600'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.404129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687902cf-dc41-4dba-8572-c8ecf18f9bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.412553 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:35.415433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6ca872b9d5400ea8e06d9488f6c600'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.415433 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6ca872b9d5400ea8e06d9488f6c600'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.426235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6ca872b9d5400ea8e06d9488f6c600'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.444034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-687902cf-dc41-4dba-8572-c8ecf18f9bf3 None None] MFA Rules not processed for user `b5b46cc501db4cf8872a4d90675fbd42`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:35.445426 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-687902cf-dc41-4dba-8572-c8ecf18f9bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:35.448686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6ca872b9d5400ea8e06d9488f6c600'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:35.455689 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1284/2552] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:35 2022] DELETE /identity/v3/users/ce6ca872b9d5400ea8e06d9488f6c600 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:35.535401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1269/2553] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:35.539938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.542281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:35.661464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85720665-0dfd-4acf-8ac5-5220a8e9baac admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.685287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.686088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.688265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.690320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.691864 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.710973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:35.768090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1285/2554] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:35 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:35.772623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687902cf-dc41-4dba-8572-c8ecf18f9bf3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.899348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687902cf-dc41-4dba-8572-c8ecf18f9bf3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:35.969213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:35.971344 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:35.992023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:35.992669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:35.992948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:35.993261 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:35.993931 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:35.995898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.022551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1270/2555] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:35 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:36.026733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.038476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558586a-2878-4c55-9434-ea9fffcd7c40 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.043770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.044400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.044750 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.045137 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.045842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.047473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.057929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1271/2556] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:36.063920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.066531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d612ac-3784-47c4-acad-5703ade73e44 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.072309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.072896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.073172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.073444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] PATH_INFO: `/v3/projects/74dac68b0b7941ba9504446a3930f0e3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.075318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=74dac68b0b7941ba9504446a3930f0e3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.075666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8404278-435c-4ddb-a29a-1a7f58bc5d4d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.077511 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.081308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.082287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.082666 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.083101 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] PATH_INFO: `/v3/projects/a5e3c91a7cba494cb432196a59c19b4e/users/e48b2706ee924395affe6eab3850018a/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.101383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e3c91a7cba494cb432196a59c19b4e, user_id=e48b2706ee924395affe6eab3850018a, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.101622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:36.104477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.109323 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:36.125459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1272/2557] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:36 2022] PUT /identity/v3/projects/a5e3c91a7cba494cb432196a59c19b4e/users/e48b2706ee924395affe6eab3850018a/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:36.129580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.140077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dac68b0b7941ba9504446a3930f0e3', 'request_id': 'req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:36.146434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dac68b0b7941ba9504446a3930f0e3', 'request_id': 'req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:36.159514 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dac68b0b7941ba9504446a3930f0e3', 'request_id': 'req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:36.177229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] The token cache is being invalidate because project 74dac68b0b7941ba9504446a3930f0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:36.177653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:36.178668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-5334f620-1f12-4b3b-a5a7-27c3acbc5edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:36.183546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1286/2558] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:35 2022] DELETE /identity/v3/projects/74dac68b0b7941ba9504446a3930f0e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:36.186144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e87af4-8ec9-44b0-b16e-6f348025d884 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.186435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e87af4-8ec9-44b0-b16e-6f348025d884 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.186710 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e87af4-8ec9-44b0-b16e-6f348025d884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.218036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-25e87af4-8ec9-44b0-b16e-6f348025d884 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:36.219317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-25e87af4-8ec9-44b0-b16e-6f348025d884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:36.225146 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa64b3a-bbf3-4173-ad49-13986b5dcbb4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.298173 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1287/2559] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:36.299079 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.299850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.300531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.300917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.301729 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.303513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.306117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d75ba-9ab1-4377-be0e-c0fa45b4efd2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.306527 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d75ba-9ab1-4377-be0e-c0fa45b4efd2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.306905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d75ba-9ab1-4377-be0e-c0fa45b4efd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.330344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1273/2560] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:36.330344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.332417 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:36.347263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3b5d75ba-9ab1-4377-be0e-c0fa45b4efd2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:36.347906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e81bc-9bf4-41ff-9b2a-af3f3ac01691 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.348731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3b5d75ba-9ab1-4377-be0e-c0fa45b4efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:36.356709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a0eb2-b911-4c20-8e5b-e9818378fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.357786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a0eb2-b911-4c20-8e5b-e9818378fc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.358289 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a0eb2-b911-4c20-8e5b-e9818378fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.358711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a0eb2-b911-4c20-8e5b-e9818378fc95 admin admin] PATH_INFO: `/v3/projects/a5e3c91a7cba494cb432196a59c19b4e/users/e48b2706ee924395affe6eab3850018a/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.359011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1288/2561] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:36.361218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a0eb2-b911-4c20-8e5b-e9818378fc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e3c91a7cba494cb432196a59c19b4e, user_id=e48b2706ee924395affe6eab3850018a, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.363070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d75ba-9ab1-4377-be0e-c0fa45b4efd2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.364194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a0eb2-b911-4c20-8e5b-e9818378fc95 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.375541 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d75ba-9ab1-4377-be0e-c0fa45b4efd2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.385095 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1274/2562] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:36 2022] PUT /identity/v3/projects/a5e3c91a7cba494cb432196a59c19b4e/users/e48b2706ee924395affe6eab3850018a/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:36.398299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.398955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.399825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.443441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] MFA Rules not processed for user `e48b2706ee924395affe6eab3850018a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:36.444937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:36.451121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.451352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.451702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.452080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.452907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:36.453363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.455234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.474587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1289/2563] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:36.475618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.487089 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a36b-e562-4fdf-ba76-f80ac8939e4f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.491739 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.492340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.492614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.492885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.493533 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.495637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.520830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1275/2564] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:36.531020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1290/2565] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:36 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:36.536197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.536369 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.537922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:36.551203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:36.552584 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:36.612156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62b2fb-6b85-4066-9e7a-079f9067fdb6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.625939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d90088-44c9-45e3-a6fd-9b9f17a06ad5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.636671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.638264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.638615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.638893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.639604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.642067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.669317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1291/2566] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:36 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:36.673408 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.675270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937e5dc-382b-4e34-932d-ae3a87e4dc30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.676138 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937e5dc-382b-4e34-932d-ae3a87e4dc30 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.676597 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937e5dc-382b-4e34-932d-ae3a87e4dc30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.676959 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937e5dc-382b-4e34-932d-ae3a87e4dc30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.686893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72130c65-9651-4022-bcd7-9838906467f0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.692814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.693435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.693709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.694227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.694666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.696299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.709182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1292/2567] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:36.713159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.725597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb70fe-0ed1-4471-b3af-e672787b4410 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.731230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.731857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.732134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.732405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.733087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.735032 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.747217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1293/2568] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:36.751668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.755021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937e5dc-382b-4e34-932d-ae3a87e4dc30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.756482 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937e5dc-382b-4e34-932d-ae3a87e4dc30 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.764261 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379801f8-e51f-4d83-ab3d-e2e074908b39 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:36.769413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1276/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:36.772229 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:36.772871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.773138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.773548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] PATH_INFO: `/v3/projects/b809062811b14761aa6c1a49b011fe00/users/4bda241a4c434f119864100ca64ede01/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.792155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b809062811b14761aa6c1a49b011fe00, user_id=4bda241a4c434f119864100ca64ede01, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:36.794963 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:36.809697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1294/2570] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:36 2022] PUT /identity/v3/projects/b809062811b14761aa6c1a49b011fe00/users/4bda241a4c434f119864100ca64ede01/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:36.820607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044867-cd94-4ace-8803-d88f6753383c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:36.820984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044867-cd94-4ace-8803-d88f6753383c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:36.821267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044867-cd94-4ace-8803-d88f6753383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:36.852815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e2044867-cd94-4ace-8803-d88f6753383c None None] MFA Rules not processed for user `4bda241a4c434f119864100ca64ede01`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:36.854030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e2044867-cd94-4ace-8803-d88f6753383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:36.920301 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.928514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1277/2571] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:36.933039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2044867-cd94-4ace-8803-d88f6753383c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:36.946318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:37.006203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432721e-8265-42b7-a11c-071548aec089 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.011571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.012553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.013079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.013636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] PATH_INFO: `/v3/users/b5b46cc501db4cf8872a4d90675fbd42` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.016077 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b46cc501db4cf8872a4d90675fbd42)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.018150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2044867-cd94-4ace-8803-d88f6753383c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.018436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.023155 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.023935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.024315 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.024690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.026196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.028265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.060575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1278/2572] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:36 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:37.065310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.074835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b46cc501db4cf8872a4d90675fbd42'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:37.083368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b46cc501db4cf8872a4d90675fbd42'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:37.084084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b46cc501db4cf8872a4d90675fbd42'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:37.086569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:37.093907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b46cc501db4cf8872a4d90675fbd42'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:37.108292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-adf843fd-cfa8-4fe2-9133-e3332138c023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b46cc501db4cf8872a4d90675fbd42'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:37.114368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1295/2573] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:36 2022] DELETE /identity/v3/users/b5b46cc501db4cf8872a4d90675fbd42 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:37.119078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.119078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.119350 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.144510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e5682-e1a9-4a24-bf57-2ab61e3d7819 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.145367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:37.146431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.223429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1296/2574] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:37.232193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.232890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.233181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.233452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.234258 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.234382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.236200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.236395 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.258679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1279/2575] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:37 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:37.264104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.266754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.284625 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82520-957d-434b-ba49-16429755b099 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.290420 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.291164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.291452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.291728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.292428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.295034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.301296 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e0fc-bddc-46c6-bd6a-bda9a3638e3b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.305070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.306307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.306307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.306307 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.307070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1280/2576] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:43:37.311900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.316809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.318252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.321985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b73bb-f4dc-4fdf-aed2-4a921bedf1e0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.328116 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ee80d-c619-4b06-8ed7-3757738ed40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.329043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1297/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:37.332394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ee80d-c619-4b06-8ed7-3757738ed40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.332394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ee80d-c619-4b06-8ed7-3757738ed40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.332394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ee80d-c619-4b06-8ed7-3757738ed40d admin admin] PATH_INFO: `/v3/projects/3c5356226e434641899971675a70b01f/users/dc0026f0bb2748f4b14523c450f1383f/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.360530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ee80d-c619-4b06-8ed7-3757738ed40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5356226e434641899971675a70b01f, user_id=dc0026f0bb2748f4b14523c450f1383f, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.364458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ee80d-c619-4b06-8ed7-3757738ed40d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.368321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:37.394131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1281/2578] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:37 2022] PUT /identity/v3/projects/3c5356226e434641899971675a70b01f/users/dc0026f0bb2748f4b14523c450f1383f/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:37.395600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.407327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c20ef-06f4-4eff-8682-fe1f9eec4291 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.504165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.504933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.505315 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.505998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.506780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.509471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.513150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.513448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.513688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.536981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:37.538529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.547383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1298/2579] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:37.548660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1282/2580] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:37.551481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.565829 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384295-7693-4259-991a-6ed2476b692a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.566944 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.568483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.578772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb1d84-37f9-4e1f-b6db-c32bbbf1592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.579782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb1d84-37f9-4e1f-b6db-c32bbbf1592b admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.580217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb1d84-37f9-4e1f-b6db-c32bbbf1592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.581112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb1d84-37f9-4e1f-b6db-c32bbbf1592b admin admin] PATH_INFO: `/v3/projects/3c5356226e434641899971675a70b01f/users/dc0026f0bb2748f4b14523c450f1383f/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.583586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb1d84-37f9-4e1f-b6db-c32bbbf1592b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5356226e434641899971675a70b01f, user_id=dc0026f0bb2748f4b14523c450f1383f, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.586772 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb1d84-37f9-4e1f-b6db-c32bbbf1592b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.603609 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1299/2581] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:37 2022] PUT /identity/v3/projects/3c5356226e434641899971675a70b01f/users/dc0026f0bb2748f4b14523c450f1383f/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:37.671791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74437c-55d7-47f9-a58a-56ab632ac0f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.677213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.677512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.677769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.692675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:37.739008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] MFA Rules not processed for user `dc0026f0bb2748f4b14523c450f1383f`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:37.740333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.783787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.784451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.784839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.784998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.827679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1300/2582] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:37.829379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.832802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.884148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.885794 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.897868 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1283/2583] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:37.898760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:37.900690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:37.911210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df592311-971d-4bd5-b1a2-beb6be5657bc None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.919663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:37.920349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:37.920627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:37.920895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] PATH_INFO: `/v3/projects/74c93466e357468681b7d4102ff702b8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:37.922285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c93466e357468681b7d4102ff702b8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:37.924457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:37.925702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:37.971769 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795c848-0317-46a0-b2f3-36f23a07189e service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:37.986510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c93466e357468681b7d4102ff702b8', 'request_id': 'req-ac751f1d-6155-4d64-996c-188de11b6169'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:37.993613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c93466e357468681b7d4102ff702b8', 'request_id': 'req-ac751f1d-6155-4d64-996c-188de11b6169'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.003988 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c93466e357468681b7d4102ff702b8', 'request_id': 'req-ac751f1d-6155-4d64-996c-188de11b6169'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.016487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] The token cache is being invalidate because project 74c93466e357468681b7d4102ff702b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:38.016942 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.017591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.024322 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1301/2584] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:37 2022] DELETE /identity/v3/projects/74c93466e357468681b7d4102ff702b8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:38.025462 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.027017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.033244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:38.033916 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.034175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.034463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.036556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.051155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:38.103195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac751f1d-6155-4d64-996c-188de11b6169 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:38.107357 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:38.108842 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:38.109197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:38.109852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.110132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.110405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] PATH_INFO: `/v3/users/e48b2706ee924395affe6eab3850018a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.111683 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48b2706ee924395affe6eab3850018a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:38.113661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:38.120474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1284/2585] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:38.161227 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48b2706ee924395affe6eab3850018a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.168744 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48b2706ee924395affe6eab3850018a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.169445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48b2706ee924395affe6eab3850018a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.177687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48b2706ee924395affe6eab3850018a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.191545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48b2706ee924395affe6eab3850018a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.198884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.200857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1302/2586] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:38 2022] DELETE /identity/v3/users/e48b2706ee924395affe6eab3850018a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:38.200991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.211964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcaad5-5c40-4402-a2ba-bd625563f742 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:38.265458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:38.266348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.266653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.266918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.268800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.312306 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:38.332715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:38.334180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:38.343503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1285/2587] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:38.494119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.495723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.577370 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e3eb6-3e98-4cbd-86fb-40be4c33266c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:38.582379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:38.583073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.583355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.583627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] PATH_INFO: `/v3/projects/a5e3c91a7cba494cb432196a59c19b4e` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.584788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e3c91a7cba494cb432196a59c19b4e)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:38.587225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:38.631809 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:38.643386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e3c91a7cba494cb432196a59c19b4e', 'request_id': 'req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.643617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.645312 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.649505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e3c91a7cba494cb432196a59c19b4e', 'request_id': 'req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.658269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e3c91a7cba494cb432196a59c19b4e', 'request_id': 'req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.661358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c84988-550a-4b7d-8a45-f128e5f4854f service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:38.670191 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] The token cache is being invalidate because project a5e3c91a7cba494cb432196a59c19b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:38.670492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.671171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8467fba9-d275-44fd-8fd4-4fbc746dd9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.672669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1303/2588] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:38 2022] DELETE /identity/v3/projects/a5e3c91a7cba494cb432196a59c19b4e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:38.677211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682778-2442-46fe-82c1-82f69597445e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.677492 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682778-2442-46fe-82c1-82f69597445e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.677769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682778-2442-46fe-82c1-82f69597445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.698256 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-39682778-2442-46fe-82c1-82f69597445e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:38.699577 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-39682778-2442-46fe-82c1-82f69597445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.720882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:38.721542 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.721823 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.722404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] PATH_INFO: `/v3/users/4bda241a4c434f119864100ca64ede01` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.723760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bda241a4c434f119864100ca64ede01)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:38.725958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:38.776957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1304/2589] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:38.777150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bda241a4c434f119864100ca64ede01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.777150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bda241a4c434f119864100ca64ede01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.779048 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafda47-4c6f-4ebc-8986-17828faafd53 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.779317 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafda47-4c6f-4ebc-8986-17828faafd53 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.779591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafda47-4c6f-4ebc-8986-17828faafd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.785467 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bda241a4c434f119864100ca64ede01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.793228 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bda241a4c434f119864100ca64ede01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.794139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f07b4a98-a549-4546-a8e6-6bb492c5793c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bda241a4c434f119864100ca64ede01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:38.799870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-fdafda47-4c6f-4ebc-8986-17828faafd53 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:38.800898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fdafda47-4c6f-4ebc-8986-17828faafd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.809582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1305/2590] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:38.813513 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafda47-4c6f-4ebc-8986-17828faafd53 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.813718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1286/2591] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:38 2022] DELETE /identity/v3/users/4bda241a4c434f119864100ca64ede01 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:38.817775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.818066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.818345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.822857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafda47-4c6f-4ebc-8986-17828faafd53 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:38.837561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:38.838768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.881708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:38.882329 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.882614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.882890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.883615 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:38.883918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:38.885528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:38.892208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:38.899390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1306/2592] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:43:38.905903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.912235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1287/2593] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:38.917966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641997-142e-4489-b86f-11f3b6549f4b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:38.919401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.923078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:38.923278 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:38.923849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:38.924131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:38.924404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:38.925125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:38.926970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:38.961127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1307/2594] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:38 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:38.965637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:38.995239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993aca-028c-4a3b-b96a-a420a1c24afe None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.005501 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:39.042253 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3b371-4a27-4d18-82aa-3f6d42e737c7 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.049027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.049849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.050126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.050551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.051361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.053613 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.057004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.057639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.057921 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.058193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.070442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.075651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.080187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1308/2595] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:38 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:39.084283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.089960 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1288/2596] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:39.096707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61453cd-0e5b-4da5-bfd3-936f68925c73 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.102516 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.102860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.103236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.103826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.104362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.106672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.125409 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1309/2597] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:39.129476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.153929 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3af96-e138-4064-b617-3c214a250acf service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.161156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a60e-a907-4b24-bd7e-541b06b3c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.162562 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a60e-a907-4b24-bd7e-541b06b3c0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.162810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a60e-a907-4b24-bd7e-541b06b3c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.163108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a60e-a907-4b24-bd7e-541b06b3c0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.163937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a60e-a907-4b24-bd7e-541b06b3c0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.167620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a60e-a907-4b24-bd7e-541b06b3c0e4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.182777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1289/2598] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:39.188017 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.200457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699b5e-7dad-4c33-a3f0-f9b69787be48 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.207872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.208599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.208874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.209148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] PATH_INFO: `/v3/projects/430cb76f57934da39bd568b486ddefa3/users/a0fcb02657b6426ba9a91c4ae71b84b2/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.227794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430cb76f57934da39bd568b486ddefa3, user_id=a0fcb02657b6426ba9a91c4ae71b84b2, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.231413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.247550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1310/2599] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:39 2022] PUT /identity/v3/projects/430cb76f57934da39bd568b486ddefa3/users/a0fcb02657b6426ba9a91c4ae71b84b2/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:39.257854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.258152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.258429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.292200 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] MFA Rules not processed for user `a0fcb02657b6426ba9a91c4ae71b84b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:39.294854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:39.361294 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1290/2600] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:39.373014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.374757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:39.416343 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.418281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:39.442548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51a69b-a7d6-4136-a6ac-2ce1df409827 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.447252 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.447972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.448316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.448651 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.458280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.459787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.466654 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:39.469690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1311/2601] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:39.491060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.494696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fab745-3a87-464b-b281-ea71b3f8bb18 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.500431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.501074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.501360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.501633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] PATH_INFO: `/v3/projects/b809062811b14761aa6c1a49b011fe00` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.501994 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6e09-e6ef-496f-afa9-6c348b0e8da0 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.502812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b809062811b14761aa6c1a49b011fe00)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.504883 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.506581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.507325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.507594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.507863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] PATH_INFO: `/v3/users/a0fcb02657b6426ba9a91c4ae71b84b2` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.509025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fcb02657b6426ba9a91c4ae71b84b2)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.510956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.565214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fcb02657b6426ba9a91c4ae71b84b2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.565698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b809062811b14761aa6c1a49b011fe00', 'request_id': 'req-7c334a27-f63b-407d-af76-f14daa8ae9c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.571950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b809062811b14761aa6c1a49b011fe00', 'request_id': 'req-7c334a27-f63b-407d-af76-f14daa8ae9c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.572105 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fcb02657b6426ba9a91c4ae71b84b2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.572694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fcb02657b6426ba9a91c4ae71b84b2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.578761 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b809062811b14761aa6c1a49b011fe00', 'request_id': 'req-7c334a27-f63b-407d-af76-f14daa8ae9c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.581971 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fcb02657b6426ba9a91c4ae71b84b2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.590711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] The token cache is being invalidate because project b809062811b14761aa6c1a49b011fe00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:39.591023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.591940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.593738 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1291/2602] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:39 2022] DELETE /identity/v3/projects/b809062811b14761aa6c1a49b011fe00 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:39.596386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-93975e09-fb10-4580-b8a1-8a88941a6374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fcb02657b6426ba9a91c4ae71b84b2'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.597334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.598688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:39.602571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1312/2603] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:39 2022] DELETE /identity/v3/users/a0fcb02657b6426ba9a91c4ae71b84b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:39.607428 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.607717 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.607995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.614754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:39.628381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:39.629588 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:39.664795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334a27-f63b-407d-af76-f14daa8ae9c4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.689406 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1313/2604] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:39.700853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:39.702522 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:39.723378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.724059 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.724344 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.724645 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] PATH_INFO: `/v3/users/dc0026f0bb2748f4b14523c450f1383f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.725824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0026f0bb2748f4b14523c450f1383f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.727836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.742135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:39.764486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdf163-2058-4054-a76a-0782e86cd5b9 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:39.770269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:39.771481 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:39.771933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:39.772434 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:39.783041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:39.784682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:39.785139 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0026f0bb2748f4b14523c450f1383f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.785815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0026f0bb2748f4b14523c450f1383f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.794157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0026f0bb2748f4b14523c450f1383f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.795414 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1314/2605] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:39.801636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0026f0bb2748f4b14523c450f1383f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.802390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0026f0bb2748f4b14523c450f1383f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:39.820093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1292/2606] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:39 2022] DELETE /identity/v3/users/dc0026f0bb2748f4b14523c450f1383f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:40.113721 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.115519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.130995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.132370 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.143060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488f3b8-7321-4da1-9302-4b5948a5771b service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.223950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.223950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.223950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.224655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] PATH_INFO: `/v3/projects/430cb76f57934da39bd568b486ddefa3` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.225688 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=430cb76f57934da39bd568b486ddefa3)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.227970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.240689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80cdbd-28fd-44b7-bd1c-ed6c9f88f5ec admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.245832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.247621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.247914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.248210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] PATH_INFO: `/v3/projects/3c5356226e434641899971675a70b01f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.249436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5356226e434641899971675a70b01f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.251409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.286863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:40.288303 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430cb76f57934da39bd568b486ddefa3', 'request_id': 'req-8465d987-591e-4896-a629-a7f0ce25d37b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.296263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430cb76f57934da39bd568b486ddefa3', 'request_id': 'req-8465d987-591e-4896-a629-a7f0ce25d37b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.303579 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430cb76f57934da39bd568b486ddefa3', 'request_id': 'req-8465d987-591e-4896-a629-a7f0ce25d37b'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.305107 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5356226e434641899971675a70b01f', 'request_id': 'req-c87d5c3e-84a4-4538-905f-4a231355767f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.311771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5356226e434641899971675a70b01f', 'request_id': 'req-c87d5c3e-84a4-4538-905f-4a231355767f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.315870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] The token cache is being invalidate because project 430cb76f57934da39bd568b486ddefa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:40.316160 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.316793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.317678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5356226e434641899971675a70b01f', 'request_id': 'req-c87d5c3e-84a4-4538-905f-4a231355767f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.318299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1315/2607] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:40 2022] DELETE /identity/v3/projects/430cb76f57934da39bd568b486ddefa3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:40.322109 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.323642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.331035 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] The token cache is being invalidate because project 3c5356226e434641899971675a70b01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:40.331325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.331938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c87d5c3e-84a4-4538-905f-4a231355767f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:40.333437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1293/2608] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:40 2022] DELETE /identity/v3/projects/3c5356226e434641899971675a70b01f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:40.334843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b24ab-f6a0-47fc-83fb-cdd706ba67f5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.335188 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b24ab-f6a0-47fc-83fb-cdd706ba67f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.335488 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b24ab-f6a0-47fc-83fb-cdd706ba67f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.357187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b69b24ab-f6a0-47fc-83fb-cdd706ba67f5 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:40.358387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b69b24ab-f6a0-47fc-83fb-cdd706ba67f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.375218 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:40.388665 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465d987-591e-4896-a629-a7f0ce25d37b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.420885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1294/2609] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:40.422073 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512959bd-391e-4a3f-9b48-5aac3c32a008 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.422485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512959bd-391e-4a3f-9b48-5aac3c32a008 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.422861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512959bd-391e-4a3f-9b48-5aac3c32a008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.440624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4d4a7-f6eb-4191-b97a-ca13237b1ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.441257 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4d4a7-f6eb-4191-b97a-ca13237b1ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.441544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4d4a7-f6eb-4191-b97a-ca13237b1ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.441825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4d4a7-f6eb-4191-b97a-ca13237b1ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.443620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-add4d4a7-f6eb-4191-b97a-ca13237b1ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.448884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-512959bd-391e-4a3f-9b48-5aac3c32a008 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:40.450793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-512959bd-391e-4a3f-9b48-5aac3c32a008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.456714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4d4a7-f6eb-4191-b97a-ca13237b1ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.458152 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4d4a7-f6eb-4191-b97a-ca13237b1ae1 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.458730 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1295/2610] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:40.460018 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57cea-6430-4951-8d4a-6746dd26b7d8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.460307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57cea-6430-4951-8d4a-6746dd26b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.460580 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57cea-6430-4951-8d4a-6746dd26b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.472720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1316/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:40.473985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceedb04-2aac-4e3f-897b-51f222d1fc72 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.474262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceedb04-2aac-4e3f-897b-51f222d1fc72 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.474542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceedb04-2aac-4e3f-897b-51f222d1fc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.481171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-43e57cea-6430-4951-8d4a-6746dd26b7d8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:40.482441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-43e57cea-6430-4951-8d4a-6746dd26b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.490320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1296/2612] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:40.494549 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57cea-6430-4951-8d4a-6746dd26b7d8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.495709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1ceedb04-2aac-4e3f-897b-51f222d1fc72 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:40.497597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1ceedb04-2aac-4e3f-897b-51f222d1fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.505227 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57cea-6430-4951-8d4a-6746dd26b7d8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.507441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1317/2613] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:40.512181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceedb04-2aac-4e3f-897b-51f222d1fc72 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.513529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.514165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.514441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.514716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.515443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:40.516011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.517623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.523169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceedb04-2aac-4e3f-897b-51f222d1fc72 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.529421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.530020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1297/2614] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:43:40.530478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.530990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.531474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.532365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:40.532671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.534542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.534698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.546187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66cf22-2658-4235-9659-601728d2c422 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.550978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1318/2615] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:43:40.553369 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.553674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.554256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.554538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.554811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.555659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.557734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.578244 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4b0c7-28a4-44fd-b432-997acccf18de admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.585716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.586729 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.586989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.587250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.587979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.591108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.594908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1298/2616] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:40.599442 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.635106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1319/2617] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:40.639203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.692617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675ec84-3063-452e-801c-5ba4aacd39b6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.705327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:40.720582 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413713a-ef43-4f04-8798-ff32cabf7807 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.729940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3e503-316e-425a-a7a6-428e84796f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.731209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e503-316e-425a-a7a6-428e84796f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.731873 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e503-316e-425a-a7a6-428e84796f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.732153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e503-316e-425a-a7a6-428e84796f7e admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.733836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3e503-316e-425a-a7a6-428e84796f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.735928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3e503-316e-425a-a7a6-428e84796f7e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.760657 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.761726 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.762222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.762594 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.763108 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1320/2618] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:40.763328 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.764352 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0406e-3197-43e4-8c24-d963555c37e1 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.764851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0406e-3197-43e4-8c24-d963555c37e1 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.766031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0406e-3197-43e4-8c24-d963555c37e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.766141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.787696 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-31e0406e-3197-43e4-8c24-d963555c37e1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:40.788910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-31e0406e-3197-43e4-8c24-d963555c37e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.789381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1299/2619] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:40.790647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.803078 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd872e13-ef71-4847-9b84-890dc6b7814b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.803666 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1321/2620] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:40.804384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0406e-3197-43e4-8c24-d963555c37e1 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.809600 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.810590 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.811128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.811379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.812143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.813841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.816233 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0406e-3197-43e4-8c24-d963555c37e1 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.819659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:40.823187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.824080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.824080 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.824934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.825654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.828662 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.830003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1300/2621] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:40.831141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.833355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:40.842898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1322/2622] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:40.842898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.852239 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d2d9-4d43-471c-a4a4-37070fcd64c0 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.859828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.860589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.860589 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.860850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.861802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.864093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.879129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1323/2623] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:40.880669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.893123 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae348-7b2e-407c-a3d3-99af8606176e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.897825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.898435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.898713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.899011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.899695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.901276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.914384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1324/2624] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:40.916181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.921717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8d0e5-f226-42d0-b93d-8ef703b98b0e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.927391 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.928016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.928295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.928565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.930231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b6ed5-223e-4732-88d8-48fb1d258739 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.935461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970ff2b-09ff-45bc-bd43-f6e1bffe0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:40.936142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970ff2b-09ff-45bc-bd43-f6e1bffe0951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.936426 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970ff2b-09ff-45bc-bd43-f6e1bffe0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.936704 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970ff2b-09ff-45bc-bd43-f6e1bffe0951 admin admin] PATH_INFO: `/v3/projects/c657bd67f12c4e0db94b9c77b43be71b/users/d034c2cd8d914968bd17ab788b3380fa/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:40.938366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.940614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.953386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970ff2b-09ff-45bc-bd43-f6e1bffe0951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c657bd67f12c4e0db94b9c77b43be71b, user_id=d034c2cd8d914968bd17ab788b3380fa, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:40.956230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970ff2b-09ff-45bc-bd43-f6e1bffe0951 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:40.959715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1301/2625] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:40.961024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:40.977258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953575c0-a663-4921-b0fb-0d0ad30aee47 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:40.979016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1325/2626] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:40 2022] PUT /identity/v3/projects/c657bd67f12c4e0db94b9c77b43be71b/users/d034c2cd8d914968bd17ab788b3380fa/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:40.984599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:40.984885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:40.985162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:41.034079 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] MFA Rules not processed for user `d034c2cd8d914968bd17ab788b3380fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:41.035616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:41.052566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147dde3-c801-4961-ac11-beb0fafcaf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:41.053683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147dde3-c801-4961-ac11-beb0fafcaf40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:41.054180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147dde3-c801-4961-ac11-beb0fafcaf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:41.055097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147dde3-c801-4961-ac11-beb0fafcaf40 admin admin] PATH_INFO: `/v3/projects/bacc7bf4bb3f4ef69c221e44ee724ec2/users/b6edbab0416147169c7123263384246a/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:41.076017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147dde3-c801-4961-ac11-beb0fafcaf40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacc7bf4bb3f4ef69c221e44ee724ec2, user_id=b6edbab0416147169c7123263384246a, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:41.078874 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147dde3-c801-4961-ac11-beb0fafcaf40 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:41.097048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1302/2627] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:40 2022] PUT /identity/v3/projects/bacc7bf4bb3f4ef69c221e44ee724ec2/users/b6edbab0416147169c7123263384246a/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:41.109415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:41.109775 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:41.109982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:41.110861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1326/2628] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:41.122775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:41.124487 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:41.146640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] MFA Rules not processed for user `b6edbab0416147169c7123263384246a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:41.148112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:41.188957 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8a4bd-d488-4a1e-b11e-1826dc19de40 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:41.224250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:41.226670 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:41.239077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1303/2629] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:41.250184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:41.251715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:41.263038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:41.263634 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:41.264056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:41.264365 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:41.314471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0ce3e-03dd-4717-8c0e-b4a39b931a2f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:41.318244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4bf2-e8c1-454a-a94f-0ed8578127b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:41.318956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4bf2-e8c1-454a-a94f-0ed8578127b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:41.319304 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4bf2-e8c1-454a-a94f-0ed8578127b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:41.319591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4bf2-e8c1-454a-a94f-0ed8578127b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:41.329733 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb4bf2-e8c1-454a-a94f-0ed8578127b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:41.331485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb4bf2-e8c1-454a-a94f-0ed8578127b6 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:41.340860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:41.342066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1304/2630] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:41.343644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:41.353311 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1327/2631] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:43.952115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:43.952546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:43.952546 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:43.979655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:43.982659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:44.068697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1305/2632] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:44.087390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:44.089241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:44.209769 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6e87-9e36-41e5-af8c-187a1e0e3e91 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:44.218669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:44.224092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:44.224092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:44.224092 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:44.240190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:44.242302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:44.256311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:44.258194 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:44.271938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1328/2633] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:44.279062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c210e60-4858-4b37-964f-2567bccec5fa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:44.284223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:44.284950 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:44.285230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:44.285671 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] PATH_INFO: `/v3/users/d373d8477581449ca1ac0b462de7ba59` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:44.294572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d373d8477581449ca1ac0b462de7ba59)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:44.295493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:44.351371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd373d8477581449ca1ac0b462de7ba59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.352091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd373d8477581449ca1ac0b462de7ba59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.361731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd373d8477581449ca1ac0b462de7ba59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.372751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd373d8477581449ca1ac0b462de7ba59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.374005 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-866ba76f-5c75-4522-9423-47176af162f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd373d8477581449ca1ac0b462de7ba59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.396663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1306/2634] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:44 2022] DELETE /identity/v3/users/d373d8477581449ca1ac0b462de7ba59 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:44.608870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:44.624468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a034218-00a5-45b2-abe2-ca5d44fce1e5 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:44.703308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:44.703308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:44.703308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:44.703308 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] PATH_INFO: `/v3/projects/1ed7c6eae05f4d949a102707cab9a626` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:44.703735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed7c6eae05f4d949a102707cab9a626)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:44.704617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:44.711870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:44.786632 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed7c6eae05f4d949a102707cab9a626', 'request_id': 'req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.796594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed7c6eae05f4d949a102707cab9a626', 'request_id': 'req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.806340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed7c6eae05f4d949a102707cab9a626', 'request_id': 'req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.820862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] The token cache is being invalidate because project 1ed7c6eae05f4d949a102707cab9a626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:44.821225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.821952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-7ef2cf7f-9c3d-4eb9-b4a1-3ba85bf2e549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:44.824008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1329/2635] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:44 2022] DELETE /identity/v3/projects/1ed7c6eae05f4d949a102707cab9a626 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:44.829280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4c0a-c955-4f58-a12f-926f5aa9629e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:44.829566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4c0a-c955-4f58-a12f-926f5aa9629e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:44.829927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4c0a-c955-4f58-a12f-926f5aa9629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:44.851556 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-30ac4c0a-c955-4f58-a12f-926f5aa9629e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:44.852801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30ac4c0a-c955-4f58-a12f-926f5aa9629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:44.862718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:44.916952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1307/2636] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:44.925419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341adc-fefd-4d69-a86d-02e33e5e8a16 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:44.925718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341adc-fefd-4d69-a86d-02e33e5e8a16 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:44.925986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341adc-fefd-4d69-a86d-02e33e5e8a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:44.945865 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6d341adc-fefd-4d69-a86d-02e33e5e8a16 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:44.947967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6d341adc-fefd-4d69-a86d-02e33e5e8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:44.958775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1330/2637] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:44.963461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac4c0a-c955-4f58-a12f-926f5aa9629e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:44.975215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac4c0a-c955-4f58-a12f-926f5aa9629e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:44.979917 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:44.981554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:44.981888 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:44.982104 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:44.982804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:44.983135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:44.984808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.000984 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1308/2638] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:45.002012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341adc-fefd-4d69-a86d-02e33e5e8a16 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.012411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341adc-fefd-4d69-a86d-02e33e5e8a16 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:45.017332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:45.017944 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.018223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.018494 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.019184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:45.021119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.048876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1331/2639] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:45 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:45.054925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.066855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a84b0a-5da2-4e3e-a0bb-2ac1b59a63cc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:45.128061 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:45.128688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.128966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.129239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.129890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:45.131844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.154089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1309/2640] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:45 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:45.158316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.169714 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8196904-be71-4401-970c-f6c8b0753a61 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:45.174398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:45.175058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.175366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.175633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.176314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:45.177893 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.188457 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1332/2641] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:45.192564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.202814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d95294-5bc9-4b04-bcf2-f2ba5cd0da60 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:45.207672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b38e2-f216-4a3e-be1a-b89d52797f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:45.208255 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b38e2-f216-4a3e-be1a-b89d52797f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.208537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b38e2-f216-4a3e-be1a-b89d52797f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.208815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b38e2-f216-4a3e-be1a-b89d52797f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.209537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b38e2-f216-4a3e-be1a-b89d52797f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:45.211174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b38e2-f216-4a3e-be1a-b89d52797f5b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.222140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1310/2642] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:45.227060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.237791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f6527-2f59-4a42-a607-150a627a8f5d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:45.242453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:45.243147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.243424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.243722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] PATH_INFO: `/v3/projects/7dbca7f387b34d3b8b58b4adb9e40e5c/users/6abe545c3047447ab6cc9618168689fa/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.258638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbca7f387b34d3b8b58b4adb9e40e5c, user_id=6abe545c3047447ab6cc9618168689fa, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:45.261306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.274193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1333/2643] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:45 2022] PUT /identity/v3/projects/7dbca7f387b34d3b8b58b4adb9e40e5c/users/6abe545c3047447ab6cc9618168689fa/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:45.285203 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58159757-b821-4284-956e-0e484b327ee0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.285493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58159757-b821-4284-956e-0e484b327ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.285772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58159757-b821-4284-956e-0e484b327ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.318174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-58159757-b821-4284-956e-0e484b327ee0 None None] MFA Rules not processed for user `6abe545c3047447ab6cc9618168689fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:45.319441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58159757-b821-4284-956e-0e484b327ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:45.383305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1311/2644] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:45.395844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.397549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:45.475167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3244-db70-4714-9d86-dcd26702408c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:45.481280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac7ca-a205-4100-bb7b-9b8b12c8f9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:45.482175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac7ca-a205-4100-bb7b-9b8b12c8f9cc service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.482458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac7ca-a205-4100-bb7b-9b8b12c8f9cc service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.482781 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac7ca-a205-4100-bb7b-9b8b12c8f9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.491312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac7ca-a205-4100-bb7b-9b8b12c8f9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:45.492877 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac7ca-a205-4100-bb7b-9b8b12c8f9cc service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.502156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1334/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:45.709543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58159757-b821-4284-956e-0e484b327ee0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.720262 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:45.774634 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58159757-b821-4284-956e-0e484b327ee0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:45.779364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:45.779983 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.780224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.780503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] PATH_INFO: `/v3/users/6abe545c3047447ab6cc9618168689fa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.781679 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6abe545c3047447ab6cc9618168689fa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:45.783719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:45.832311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6abe545c3047447ab6cc9618168689fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:45.832985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6abe545c3047447ab6cc9618168689fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:45.842774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6abe545c3047447ab6cc9618168689fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:45.851094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6abe545c3047447ab6cc9618168689fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:45.851778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6abe545c3047447ab6cc9618168689fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:45.872948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1312/2646] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:45 2022] DELETE /identity/v3/users/6abe545c3047447ab6cc9618168689fa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:45.878180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:45.878467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:45.878861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:45.900189 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:45.901379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:45.915177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:45.979647 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1335/2647] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:45.990217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:45.992530 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:46.055207 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305b04-3c61-45e3-ba5a-69f1af4ca764 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.059464 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1080788-e28c-420d-a48e-abceb4a7f10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.060330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1080788-e28c-420d-a48e-abceb4a7f10f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.060503 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1080788-e28c-420d-a48e-abceb4a7f10f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.060788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1080788-e28c-420d-a48e-abceb4a7f10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.070229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1080788-e28c-420d-a48e-abceb4a7f10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.071702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1080788-e28c-420d-a48e-abceb4a7f10f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.082572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1313/2648] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:46.368730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.370192 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:46.383934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c315b-ddf0-45ba-93d8-380a44e27d0b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.392147 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.393171 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.393528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.393880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] PATH_INFO: `/v3/projects/7dbca7f387b34d3b8b58b4adb9e40e5c` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.395198 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbca7f387b34d3b8b58b4adb9e40e5c)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.397263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.459814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbca7f387b34d3b8b58b4adb9e40e5c', 'request_id': 'req-17c6bc2a-258a-4e53-9977-9dffe96d538a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:46.466193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbca7f387b34d3b8b58b4adb9e40e5c', 'request_id': 'req-17c6bc2a-258a-4e53-9977-9dffe96d538a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:46.476045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbca7f387b34d3b8b58b4adb9e40e5c', 'request_id': 'req-17c6bc2a-258a-4e53-9977-9dffe96d538a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:46.489860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] The token cache is being invalidate because project 7dbca7f387b34d3b8b58b4adb9e40e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:46.490153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:46.490803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-17c6bc2a-258a-4e53-9977-9dffe96d538a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:46.492338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1336/2649] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:46 2022] DELETE /identity/v3/projects/7dbca7f387b34d3b8b58b4adb9e40e5c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:46.498065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fdd2d-026a-498d-975d-7148a31bfd8a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.499688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fdd2d-026a-498d-975d-7148a31bfd8a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.499688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fdd2d-026a-498d-975d-7148a31bfd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.522672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a32fdd2d-026a-498d-975d-7148a31bfd8a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:46.524185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a32fdd2d-026a-498d-975d-7148a31bfd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:46.550214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:46.587495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1314/2650] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:46.595805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a783f7-3c8c-4daa-b1c5-2b3c512d9ecb None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.596287 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a783f7-3c8c-4daa-b1c5-2b3c512d9ecb None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.596653 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a783f7-3c8c-4daa-b1c5-2b3c512d9ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.617051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-b7a783f7-3c8c-4daa-b1c5-2b3c512d9ecb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:46.618247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-b7a783f7-3c8c-4daa-b1c5-2b3c512d9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:46.626709 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1337/2651] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:46.631042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fdd2d-026a-498d-975d-7148a31bfd8a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.641131 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fdd2d-026a-498d-975d-7148a31bfd8a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.645992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.646605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.646881 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.647189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.647861 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:46.648162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.649725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.664834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1315/2652] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:46.665910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a783f7-3c8c-4daa-b1c5-2b3c512d9ecb None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.675793 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a783f7-3c8c-4daa-b1c5-2b3c512d9ecb None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.680598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.681214 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.681614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.681892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.682555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.685341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.717133 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1338/2653] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:46 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:46.721999 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.732860 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d95c8-4ceb-4bcc-a6dc-66280042fbd3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.795485 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.796222 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.796502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.796774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.797439 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.800290 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.823136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1316/2654] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:46 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:46.828062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.838886 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548827c-11b0-4a04-b70c-4eaae0af76de admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.843871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.844489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.844780 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.845056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.845750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.847397 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.857503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1339/2655] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:46.861568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.872115 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a518-d845-4f67-8d3d-f8cb70002ee5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.876757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192775b-c24e-451f-b524-af7b3a00ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.877373 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192775b-c24e-451f-b524-af7b3a00ae9a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.877655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192775b-c24e-451f-b524-af7b3a00ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.877934 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192775b-c24e-451f-b524-af7b3a00ae9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.878626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192775b-c24e-451f-b524-af7b3a00ae9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.880282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192775b-c24e-451f-b524-af7b3a00ae9a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.891990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1317/2656] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:46.896099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.908306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005a8c0-9967-4831-b07f-bcce3eb3d68e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:46.913153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:46.913827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.914104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.914377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] PATH_INFO: `/v3/projects/e2458acb4ebc4ad2848624912d02abf5/users/4f462ac8125c451c97f34443e37d4d5b/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.931981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2458acb4ebc4ad2848624912d02abf5, user_id=4f462ac8125c451c97f34443e37d4d5b, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:46.935368 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:46.948482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1340/2657] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:46 2022] PUT /identity/v3/projects/e2458acb4ebc4ad2848624912d02abf5/users/4f462ac8125c451c97f34443e37d4d5b/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:46.960879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3929a6-d850-4fd9-aef3-744df7198e11 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:46.961164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3929a6-d850-4fd9-aef3-744df7198e11 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:46.961437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3929a6-d850-4fd9-aef3-744df7198e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:46.972881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:46.974742 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.001186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7a3929a6-d850-4fd9-aef3-744df7198e11 None None] MFA Rules not processed for user `4f462ac8125c451c97f34443e37d4d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:47.002422 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7a3929a6-d850-4fd9-aef3-744df7198e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.038965 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:47.074211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328f3c-da16-4976-9ea5-34997970b455 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.079624 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.080415 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.080699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.080972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] PATH_INFO: `/v3/users/b6edbab0416147169c7123263384246a` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.082163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6edbab0416147169c7123263384246a)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.084599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.102886 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1318/2658] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:47.103800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3929a6-d850-4fd9-aef3-744df7198e11 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.122060 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3929a6-d850-4fd9-aef3-744df7198e11 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.127659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.128322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.128656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.129025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.129647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.131923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.162372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6edbab0416147169c7123263384246a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:47.170182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6edbab0416147169c7123263384246a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:47.170716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6edbab0416147169c7123263384246a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:47.175570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1319/2659] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:47 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:47.179461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.181697 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.184309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6edbab0416147169c7123263384246a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:47.188682 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:47.202586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-83d5386a-8614-4de1-9162-76ddd7f15d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6edbab0416147169c7123263384246a'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:47.209890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1341/2660] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:46 2022] DELETE /identity/v3/users/b6edbab0416147169c7123263384246a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:47.215430 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.215861 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.216444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.242425 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:47.244071 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.291360 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330c94c-aa55-4d11-90b2-e70eb9f54884 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.378771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1342/2661] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:47.380788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.381561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.383278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.383574 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.384287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.386216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.388569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.396028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.411841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1320/2662] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:47 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:47.415715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.426473 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f78b93-94f5-4a5a-a5a9-4695c0a7418b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.432080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.432900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.433927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.434571 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.435392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.437335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.451000 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1321/2663] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:47.452071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.461869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608af40-89cc-4067-a1b5-9d16bb30f8b3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.467458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.468128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.468414 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.468690 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] PATH_INFO: `/v3/projects/691656358ab64942b50fb49df135f7cc/users/c7f9a78a3a45475ab0a23c1cd5fc81a7/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.476455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c48de-7c9c-4969-a6d8-14117dd0da28 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.481669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.482637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.482637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.483069 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.485741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=691656358ab64942b50fb49df135f7cc, user_id=c7f9a78a3a45475ab0a23c1cd5fc81a7, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.489850 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.493972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.496891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.502085 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:47.506915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1322/2664] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:47 2022] PUT /identity/v3/projects/691656358ab64942b50fb49df135f7cc/users/c7f9a78a3a45475ab0a23c1cd5fc81a7/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:47.510612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.512674 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1343/2665] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:47.595430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4d15-3da2-4b9c-a8f0-7cdfa227d6aa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.600744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662896ce-8eaf-4219-88db-19a811213a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.602014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662896ce-8eaf-4219-88db-19a811213a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.602269 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662896ce-8eaf-4219-88db-19a811213a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.602552 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662896ce-8eaf-4219-88db-19a811213a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.603303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662896ce-8eaf-4219-88db-19a811213a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.605036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662896ce-8eaf-4219-88db-19a811213a50 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.617195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1323/2666] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:47.621084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.631727 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31415aa0-65a3-4e10-a183-1244ee5a0f40 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.641560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.642560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.642851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.643162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] PATH_INFO: `/v3/projects/691656358ab64942b50fb49df135f7cc/users/c7f9a78a3a45475ab0a23c1cd5fc81a7/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.645215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691656358ab64942b50fb49df135f7cc, user_id=c7f9a78a3a45475ab0a23c1cd5fc81a7, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.650129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.675991 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1344/2667] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:47 2022] PUT /identity/v3/projects/691656358ab64942b50fb49df135f7cc/users/c7f9a78a3a45475ab0a23c1cd5fc81a7/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:47.685778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.686173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.686436 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.707914 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:47.738055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] MFA Rules not processed for user `c7f9a78a3a45475ab0a23c1cd5fc81a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:47.739763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.837581 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1324/2668] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:47.856800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.858601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.905708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:47.905708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:47.940082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304565cd-bf12-43b0-87c8-2923280baa80 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.943852 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.944483 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.944762 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.945037 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.956892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:47.958339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:47.968703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1345/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:47.989297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed923-398c-4b39-9b24-f455a2a52529 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:47.995593 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:47.996702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:47.996994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:47.997393 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] PATH_INFO: `/v3/projects/bacc7bf4bb3f4ef69c221e44ee724ec2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:47.998711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacc7bf4bb3f4ef69c221e44ee724ec2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.001121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.057959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.059495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacc7bf4bb3f4ef69c221e44ee724ec2', 'request_id': 'req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:48.068570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacc7bf4bb3f4ef69c221e44ee724ec2', 'request_id': 'req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:48.068966 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710188f3-49d9-4978-8104-16a9858df867 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.075354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacc7bf4bb3f4ef69c221e44ee724ec2', 'request_id': 'req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:48.091176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] The token cache is being invalidate because project bacc7bf4bb3f4ef69c221e44ee724ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:48.091541 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:48.092683 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0ae31dbf-3d8e-4ed6-b04c-ad4fe18c0713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:48.094828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1325/2670] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:47 2022] DELETE /identity/v3/projects/bacc7bf4bb3f4ef69c221e44ee724ec2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:48.099575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ff28-e031-4867-9d0c-4a6f8fab98d0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.099935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ff28-e031-4867-9d0c-4a6f8fab98d0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.100678 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ff28-e031-4867-9d0c-4a6f8fab98d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.125908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7df6ff28-e031-4867-9d0c-4a6f8fab98d0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:48.126585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.127312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.127432 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7df6ff28-e031-4867-9d0c-4a6f8fab98d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:48.127708 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.128047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.129898 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:48.142121 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:48.196710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1326/2671] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:48.206744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451343e-1d41-4379-95de-7b74d2c8876b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.207097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451343e-1d41-4379-95de-7b74d2c8876b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.207338 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451343e-1d41-4379-95de-7b74d2c8876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.207429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.208854 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.219292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1346/2672] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:48.232476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b451343e-1d41-4379-95de-7b74d2c8876b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:48.234994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b451343e-1d41-4379-95de-7b74d2c8876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:48.248901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1327/2673] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:48.252215 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.264095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de86f7-4d95-421f-991b-17affb984791 service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.268983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.269856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.270124 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.270395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.271353 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:48.271658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.273509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.286975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1347/2674] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:48.291534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451343e-1d41-4379-95de-7b74d2c8876b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.302952 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451343e-1d41-4379-95de-7b74d2c8876b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.311674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.312955 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.313379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.313728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.314862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.325727 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.358145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1328/2675] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:48 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:48.362245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.375587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84d793-ccd5-43f2-8b8a-d35cb5f75258 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.433616 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:48.461922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.462605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.463046 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.463499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.464894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.467211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.495292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1348/2676] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:48 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:48.497570 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.510908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e88d92-e919-4e2d-b5d0-8a741572dd61 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.520153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.521068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.521268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.521718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.522699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.524512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.537652 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1329/2677] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:48.541825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.557903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb7c6-ff59-4841-94d9-789e1da5f051 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.570444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44103db2-bd16-42f2-8fb1-9c88a7c1f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.571538 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44103db2-bd16-42f2-8fb1-9c88a7c1f137 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.572117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44103db2-bd16-42f2-8fb1-9c88a7c1f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.572504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44103db2-bd16-42f2-8fb1-9c88a7c1f137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.573461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44103db2-bd16-42f2-8fb1-9c88a7c1f137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.575842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44103db2-bd16-42f2-8fb1-9c88a7c1f137 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.587967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1349/2678] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:48.592550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.606042 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1fb9d-5b40-40ed-b970-db6e5bb10717 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.617526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.618828 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.619143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.619423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] PATH_INFO: `/v3/projects/c948bd1ebfee4a8dba9a1f40f8feaee6/users/0eeab65d91ff4a03bd683996c28224c6/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.637745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c948bd1ebfee4a8dba9a1f40f8feaee6, user_id=0eeab65d91ff4a03bd683996c28224c6, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.640431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.657770 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1330/2679] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:48 2022] PUT /identity/v3/projects/c948bd1ebfee4a8dba9a1f40f8feaee6/users/0eeab65d91ff4a03bd683996c28224c6/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:48.725919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad4c9-2b01-4fc7-aee3-a64df86d00c8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.726437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad4c9-2b01-4fc7-aee3-a64df86d00c8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.726819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad4c9-2b01-4fc7-aee3-a64df86d00c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.766201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-abbad4c9-2b01-4fc7-aee3-a64df86d00c8 None None] MFA Rules not processed for user `0eeab65d91ff4a03bd683996c28224c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:48.767445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-abbad4c9-2b01-4fc7-aee3-a64df86d00c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:48.830262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1350/2680] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:48.835038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.897217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e861a-6a17-4cc4-bf51-4a442e38328f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:48.901700 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:48.902994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:48.903279 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:48.903551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:48.904211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:48.906112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:48.931686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1331/2681] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:48 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:48.935871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad4c9-2b01-4fc7-aee3-a64df86d00c8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:48.946243 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad4c9-2b01-4fc7-aee3-a64df86d00c8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.001946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.002560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.002840 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.003142 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.003803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.005702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.026671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1351/2682] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:48 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:49.030822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.041031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb5598-40eb-49df-a26f-29cb5e299ae6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.046819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.047551 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.047855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.048127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.048812 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.050404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.061444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1332/2683] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:49.065246 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.075806 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798aa88-5121-4ed8-8236-94a5f020aa66 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.080327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beafe1-9d6b-4dae-9e35-ba36524588ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.080921 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beafe1-9d6b-4dae-9e35-ba36524588ae admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.081197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beafe1-9d6b-4dae-9e35-ba36524588ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.081466 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beafe1-9d6b-4dae-9e35-ba36524588ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.082141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36beafe1-9d6b-4dae-9e35-ba36524588ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.083746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36beafe1-9d6b-4dae-9e35-ba36524588ae admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.093547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1352/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:49.097398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.107277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a1d29-84be-4894-8cb9-141beab8e5f5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.111831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.112479 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.112760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.113030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] PATH_INFO: `/v3/projects/a131910aca024022a6c747b349be1344/users/8b8f4cb0a564444da311158a62b754ed/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.128595 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a131910aca024022a6c747b349be1344, user_id=8b8f4cb0a564444da311158a62b754ed, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.131303 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.144869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1333/2685] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:49 2022] PUT /identity/v3/projects/a131910aca024022a6c747b349be1344/users/8b8f4cb0a564444da311158a62b754ed/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:49.155184 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28295-7426-4d02-84f0-0057f28f404f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.155419 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28295-7426-4d02-84f0-0057f28f404f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.155693 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28295-7426-4d02-84f0-0057f28f404f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.182669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-abb28295-7426-4d02-84f0-0057f28f404f None None] MFA Rules not processed for user `8b8f4cb0a564444da311158a62b754ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:49.184455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-abb28295-7426-4d02-84f0-0057f28f404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:49.188410 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:49.251204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1353/2686] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:49.255716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.261392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:49.318318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee32fcd-a72a-4278-8aa5-e109484f9814 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.323027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.323644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.324672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.325099 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.325772 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.327735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.354166 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1334/2687] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:49 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:49.359126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28295-7426-4d02-84f0-0057f28f404f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.369817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28295-7426-4d02-84f0-0057f28f404f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.425363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.425902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.426193 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.426452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.427151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.429072 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.456539 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1354/2688] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:49 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:49.460557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.471575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690567-b9bc-4cea-bc8d-6dd5a9d8411c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.476113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.476725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.477003 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.477267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.477956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.479582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.493793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1335/2689] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:49.494903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.506103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292e8c-d9d1-4757-8336-2b804c688b0b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.510901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.511835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.512336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.512720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] PATH_INFO: `/v3/projects/23d9fedbb80b459e8d2af80f40e77438/users/ad60cefa196e4fb7a74145faa79a2d7d/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.529306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d9fedbb80b459e8d2af80f40e77438, user_id=ad60cefa196e4fb7a74145faa79a2d7d, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.531974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.544863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1355/2690] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:49 2022] PUT /identity/v3/projects/23d9fedbb80b459e8d2af80f40e77438/users/ad60cefa196e4fb7a74145faa79a2d7d/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:49.548969 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.560221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e1af-0140-45e8-84d6-6a1b2c592f77 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.629801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e80d8a-8ff8-4364-aba1-203f1177a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.630435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e80d8a-8ff8-4364-aba1-203f1177a7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.630719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e80d8a-8ff8-4364-aba1-203f1177a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.631034 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e80d8a-8ff8-4364-aba1-203f1177a7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.631741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e80d8a-8ff8-4364-aba1-203f1177a7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.633387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e80d8a-8ff8-4364-aba1-203f1177a7ab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.645431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1336/2691] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:49.650309 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.663510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b390d9b-ec4a-4e2e-a31d-597386358a95 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.670067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.671706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.671934 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.672224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] PATH_INFO: `/v3/projects/23d9fedbb80b459e8d2af80f40e77438/users/ad60cefa196e4fb7a74145faa79a2d7d/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.674399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d9fedbb80b459e8d2af80f40e77438, user_id=ad60cefa196e4fb7a74145faa79a2d7d, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:49.677149 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:49.689817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1356/2692] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:49 2022] PUT /identity/v3/projects/23d9fedbb80b459e8d2af80f40e77438/users/ad60cefa196e4fb7a74145faa79a2d7d/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:49.703466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.703757 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.704039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.742016 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] MFA Rules not processed for user `ad60cefa196e4fb7a74145faa79a2d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:49.743310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:49.857305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:49.865075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1337/2693] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:49.878389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:49.880234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:49.966598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9507-1b4f-48cd-8f49-26582bc37745 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:49.970671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:49.971340 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:49.971617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:49.971882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:49.981743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:50.032591 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:50.034051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:50.043890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1357/2694] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:51.548342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:51.549774 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:51.562071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bb36-c5e3-40e9-bf84-ed2f493ca882 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:51.565591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ffa9-098b-48c8-aa87-7d87489d5288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:51.566202 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ffa9-098b-48c8-aa87-7d87489d5288 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:51.566474 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ffa9-098b-48c8-aa87-7d87489d5288 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:51.566739 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ffa9-098b-48c8-aa87-7d87489d5288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:51.623021 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ffa9-098b-48c8-aa87-7d87489d5288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:51.624372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ffa9-098b-48c8-aa87-7d87489d5288 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:51.633196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1338/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:51.887897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:51.889359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:51.961091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81ac7-d87e-430c-ab99-5ed010231ccd service cinder] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:51.965936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:51.966580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:51.966863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:51.967270 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] PATH_INFO: `/v3/users/d034c2cd8d914968bd17ab788b3380fa` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:51.968976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d034c2cd8d914968bd17ab788b3380fa)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:51.970903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:52.022240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd034c2cd8d914968bd17ab788b3380fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.030234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd034c2cd8d914968bd17ab788b3380fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.031524 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd034c2cd8d914968bd17ab788b3380fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.039166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd034c2cd8d914968bd17ab788b3380fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.051248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd034c2cd8d914968bd17ab788b3380fa'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.057067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1358/2696] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:51 2022] DELETE /identity/v3/users/d034c2cd8d914968bd17ab788b3380fa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:52.062193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.062486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.062815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.082030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:52.083263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:52.144157 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1339/2697] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:52.154269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:52.155856 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:52.164674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:52.166082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:52.193380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:52.223418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0625e01-a09a-416b-a412-20814c9bd606 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:52.228720 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:52.229418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.229700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.230593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.231834 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26c9fa-5891-401e-8004-23e78f0273a6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:52.236760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52079c68-7346-4e73-8f9b-dceed498c007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:52.237399 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52079c68-7346-4e73-8f9b-dceed498c007 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.237743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52079c68-7346-4e73-8f9b-dceed498c007 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.237947 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52079c68-7346-4e73-8f9b-dceed498c007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.240830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-52079c68-7346-4e73-8f9b-dceed498c007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:52.244556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:52.247250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:52.260685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1359/2698] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:52.308833 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:52.337234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52079c68-7346-4e73-8f9b-dceed498c007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:52.343140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52079c68-7346-4e73-8f9b-dceed498c007 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:52.360763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1340/2699] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:52.603424 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:52.605912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:52.629605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21a2d9-a87c-4b05-8db9-b499519e928d service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:52.635778 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:52.637439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.637724 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.638058 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] PATH_INFO: `/v3/projects/c657bd67f12c4e0db94b9c77b43be71b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.640126 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c657bd67f12c4e0db94b9c77b43be71b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:52.643011 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:52.696250 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c657bd67f12c4e0db94b9c77b43be71b', 'request_id': 'req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.703083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c657bd67f12c4e0db94b9c77b43be71b', 'request_id': 'req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.711450 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c657bd67f12c4e0db94b9c77b43be71b', 'request_id': 'req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.725980 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] The token cache is being invalidate because project c657bd67f12c4e0db94b9c77b43be71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:52.726349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.727088 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-6f593b44-f67b-43c2-9fb5-79c4ebba5a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:52.728928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1360/2700] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:52 2022] DELETE /identity/v3/projects/c657bd67f12c4e0db94b9c77b43be71b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:52.734418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09063d2-783f-499e-8608-0c29836cef21 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.734926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09063d2-783f-499e-8608-0c29836cef21 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.735077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09063d2-783f-499e-8608-0c29836cef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.754717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f09063d2-783f-499e-8608-0c29836cef21 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:52.755970 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f09063d2-783f-499e-8608-0c29836cef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:52.822230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1341/2701] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:52.830364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf879c64-60d0-4d63-be82-8a1f6e0c759f None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.830652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf879c64-60d0-4d63-be82-8a1f6e0c759f None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.830946 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf879c64-60d0-4d63-be82-8a1f6e0c759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.851595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bf879c64-60d0-4d63-be82-8a1f6e0c759f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:52.852804 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bf879c64-60d0-4d63-be82-8a1f6e0c759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:52.861836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1361/2702] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:52.866428 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09063d2-783f-499e-8608-0c29836cef21 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:52.876767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09063d2-783f-499e-8608-0c29836cef21 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:52.881477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:52.882092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.882374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.882647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.883493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:52.883805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:52.885392 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:52.897433 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1342/2703] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:52.902600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf879c64-60d0-4d63-be82-8a1f6e0c759f None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:52.911836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf879c64-60d0-4d63-be82-8a1f6e0c759f None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:52.918347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:52.918999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:52.919283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:52.919558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:52.920240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:52.922153 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:52.952798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1362/2704] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:52 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:52.957192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:52.968301 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a590ce3-b52c-4454-8dc9-1e9771a856ab admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:53.024471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:53.025094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:53.025378 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:53.025653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:53.026322 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:53.028300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:53.048882 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1343/2705] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:52 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:53.052937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:53.063736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b2084-f979-43fb-a602-d1780708a3b8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:53.068343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:53.068953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:53.069234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:53.069508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:53.070195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:53.071825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:53.082475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1363/2706] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:53.086311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:53.096413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156c74-d415-40c8-bdcb-0cf589d451b0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:53.101094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c2900-840e-4966-a9f2-47fd1698c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:53.101711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c2900-840e-4966-a9f2-47fd1698c6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:53.101988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c2900-840e-4966-a9f2-47fd1698c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:53.102259 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c2900-840e-4966-a9f2-47fd1698c6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:53.102958 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c2900-840e-4966-a9f2-47fd1698c6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:53.104607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c2900-840e-4966-a9f2-47fd1698c6a6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:53.117275 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1344/2707] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:53.122871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:53.132896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ddf5d-3d34-41c3-9cb7-53534eb153d3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:53.138201 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:53.138857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:53.139241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:53.139537 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] PATH_INFO: `/v3/projects/234be4e4eb0a434a9bc6c3d03ac01776/users/b8739e8f195a4441bbbf9189cf3dd4a5/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:53.154788 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234be4e4eb0a434a9bc6c3d03ac01776, user_id=b8739e8f195a4441bbbf9189cf3dd4a5, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:53.157509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:53.171500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1364/2708] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:53 2022] PUT /identity/v3/projects/234be4e4eb0a434a9bc6c3d03ac01776/users/b8739e8f195a4441bbbf9189cf3dd4a5/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:53.181791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:53.182082 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:53.182358 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:53.211872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] MFA Rules not processed for user `b8739e8f195a4441bbbf9189cf3dd4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:53.213084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:53.260086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:53.282568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1345/2709] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:53.294563 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:53.296263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:53.353719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4c700-4523-4966-b0e5-4e7fb23ab520 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:53.358598 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cc2b2-3ae7-49fc-bdf0-72b9b8567bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:53.359263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cc2b2-3ae7-49fc-bdf0-72b9b8567bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:53.359544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cc2b2-3ae7-49fc-bdf0-72b9b8567bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:53.359817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cc2b2-3ae7-49fc-bdf0-72b9b8567bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:53.366443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:53.369234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cc2b2-3ae7-49fc-bdf0-72b9b8567bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:53.372617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cc2b2-3ae7-49fc-bdf0-72b9b8567bb6 service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:53.385127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1365/2710] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:55.423561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:55.425028 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:55.491849 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00362d3-1e42-4586-94bf-7d81b4e99def None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:55.496229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:55.496867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:55.497140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:55.497409 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] PATH_INFO: `/v3/users/4f462ac8125c451c97f34443e37d4d5b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:55.498537 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f462ac8125c451c97f34443e37d4d5b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:55.500514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:55.546768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f462ac8125c451c97f34443e37d4d5b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:55.547559 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f462ac8125c451c97f34443e37d4d5b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:55.554504 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f462ac8125c451c97f34443e37d4d5b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:55.561318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f462ac8125c451c97f34443e37d4d5b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:55.561975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f462ac8125c451c97f34443e37d4d5b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:55.585308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1346/2711] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:55 2022] DELETE /identity/v3/users/4f462ac8125c451c97f34443e37d4d5b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:55.590687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:55.591187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:55.591288 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:55.609723 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:55.610952 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:55.669686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1366/2712] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:55.679310 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:55.680711 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:55.737855 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942193-7728-4cf5-acde-f49456c1567a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:55.741510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:55.742191 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:55.742412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:55.742684 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:55.752550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:55.753979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:55.763659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1347/2713] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:56.037602 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:56.039388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.054697 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68a751-ac81-42d5-9780-ef1f3bf34783 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:56.065679 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:56.066375 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.066654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.066953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] PATH_INFO: `/v3/projects/e2458acb4ebc4ad2848624912d02abf5` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.068197 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2458acb4ebc4ad2848624912d02abf5)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:56.070145 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:56.123084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2458acb4ebc4ad2848624912d02abf5', 'request_id': 'req-ef713dcf-e6c7-4203-9d5d-8d480a808200'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.129134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2458acb4ebc4ad2848624912d02abf5', 'request_id': 'req-ef713dcf-e6c7-4203-9d5d-8d480a808200'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.137377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2458acb4ebc4ad2848624912d02abf5', 'request_id': 'req-ef713dcf-e6c7-4203-9d5d-8d480a808200'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.150001 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] The token cache is being invalidate because project e2458acb4ebc4ad2848624912d02abf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:56.150334 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.150981 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.153482 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1367/2714] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:56 2022] DELETE /identity/v3/projects/e2458acb4ebc4ad2848624912d02abf5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:56.157491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:56.168858 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894ca96-230f-4daa-ac5f-9b08620baf96 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:56.172768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:56.239722 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:56.240405 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.240689 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.240965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] PATH_INFO: `/v3/users/c7f9a78a3a45475ab0a23c1cd5fc81a7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.242186 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f9a78a3a45475ab0a23c1cd5fc81a7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:56.244225 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:56.299182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f9a78a3a45475ab0a23c1cd5fc81a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.300085 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f9a78a3a45475ab0a23c1cd5fc81a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.309097 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f9a78a3a45475ab0a23c1cd5fc81a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.316416 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f9a78a3a45475ab0a23c1cd5fc81a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.317080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-586cc840-a611-4ba2-a6df-93ea9d386d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f9a78a3a45475ab0a23c1cd5fc81a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.339954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1348/2715] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:56 2022] DELETE /identity/v3/users/c7f9a78a3a45475ab0a23c1cd5fc81a7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:56.410652 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:56.412407 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.426752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713dcf-e6c7-4203-9d5d-8d480a808200 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:56.503960 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:56.504612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.504911 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.505166 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] PATH_INFO: `/v3/users/0eeab65d91ff4a03bd683996c28224c6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.506503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eeab65d91ff4a03bd683996c28224c6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:56.508702 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:56.545805 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:56.572314 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eeab65d91ff4a03bd683996c28224c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.579844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eeab65d91ff4a03bd683996c28224c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.580525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eeab65d91ff4a03bd683996c28224c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.588764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eeab65d91ff4a03bd683996c28224c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.601346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eeab65d91ff4a03bd683996c28224c6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.608121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1368/2716] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:56 2022] DELETE /identity/v3/users/0eeab65d91ff4a03bd683996c28224c6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:56.612520 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.613051 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.613154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.635496 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:56.637075 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.643993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:56.645661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.708236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1349/2717] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:56.718557 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:56.719180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e7658-7f7b-4fae-992a-dce993a258bd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:56.720103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.724366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:56.725281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.725648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.726014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] PATH_INFO: `/v3/projects/691656358ab64942b50fb49df135f7cc` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.727328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691656358ab64942b50fb49df135f7cc)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:56.729318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:56.753903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:56.784219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691656358ab64942b50fb49df135f7cc', 'request_id': 'req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.785080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50f2f-41f3-4e9f-8266-037cfd9b043b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:56.789764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691656358ab64942b50fb49df135f7cc', 'request_id': 'req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.799128 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691656358ab64942b50fb49df135f7cc', 'request_id': 'req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.810895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] The token cache is being invalidate because project 691656358ab64942b50fb49df135f7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:56.811220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.811872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-3dd71a67-8cad-4d8f-8bc9-b5a1d35a9d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:56.813376 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1369/2718] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:56 2022] DELETE /identity/v3/projects/691656358ab64942b50fb49df135f7cc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:56.817929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96ba7-41cb-490b-8d38-14ea9f311ef6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.818281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96ba7-41cb-490b-8d38-14ea9f311ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.818551 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96ba7-41cb-490b-8d38-14ea9f311ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.837631 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-e4d96ba7-41cb-490b-8d38-14ea9f311ef6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:56.838814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e4d96ba7-41cb-490b-8d38-14ea9f311ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.841705 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:56.842326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.842606 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.842877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.844633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.865054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:56.905813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1370/2719] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:56.913672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24935-bf0f-44d5-88a8-6f515510ad16 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.913955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24935-bf0f-44d5-88a8-6f515510ad16 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.914226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24935-bf0f-44d5-88a8-6f515510ad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.915274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:56.916751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:56.927002 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1350/2720] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:56.934106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-2fa24935-bf0f-44d5-88a8-6f515510ad16 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:56.935512 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-2fa24935-bf0f-44d5-88a8-6f515510ad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:56.943583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1371/2721] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:56.947699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:56.958091 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176462c-d91b-4798-9d34-e051098e9053 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:56.962848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:56.963489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:56.963767 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:56.964656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:56.965353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:56.965650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:56.967278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:56.978692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1351/2722] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:43:56.983926 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa24935-bf0f-44d5-88a8-6f515510ad16 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:56.994701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa24935-bf0f-44d5-88a8-6f515510ad16 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.000392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.001125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.001404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.001671 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.002327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.004260 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.033456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1372/2723] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:56 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:57.037863 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.049935 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d21f2f-aefb-4f17-8f6b-6800620054ed admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.112466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.113239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.113582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.113920 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.114579 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.116528 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.138382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1352/2724] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:57 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:57.142764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.153907 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81054257-978d-4310-b1a0-7fdbbb5cc34d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.158748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.159402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.159682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.159956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.160672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.162265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.172348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1373/2725] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:57.176531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.191777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3dd02-9c8b-43b0-a5d7-5cf92f0bf715 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.197418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.198181 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.199910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.199910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.200237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.202792 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.205139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.206912 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:57.207324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:57.219637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1353/2726] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:57.224072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.237386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c06eb-4c42-4ab9-9bae-8e32c3b3956b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.243502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c98d0-978f-4386-b2c6-a66f7e484dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.244189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c98d0-978f-4386-b2c6-a66f7e484dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.244501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c98d0-978f-4386-b2c6-a66f7e484dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.244754 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c98d0-978f-4386-b2c6-a66f7e484dc2 admin admin] PATH_INFO: `/v3/projects/623a6bf534d84824a9ab4e9b98bcc44d/users/f882f4fc40fe43f08f9906a406c24411/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.250900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f45002-ff12-4b9b-b765-479c3fcac70d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.257164 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.257816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.258180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.258473 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] PATH_INFO: `/v3/projects/c948bd1ebfee4a8dba9a1f40f8feaee6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.259587 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c948bd1ebfee4a8dba9a1f40f8feaee6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.261770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.265885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c98d0-978f-4386-b2c6-a66f7e484dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623a6bf534d84824a9ab4e9b98bcc44d, user_id=f882f4fc40fe43f08f9906a406c24411, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.269445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c98d0-978f-4386-b2c6-a66f7e484dc2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.288776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1354/2727] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:57 2022] PUT /identity/v3/projects/623a6bf534d84824a9ab4e9b98bcc44d/users/f882f4fc40fe43f08f9906a406c24411/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:57.301591 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.302057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.302554 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.321525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c948bd1ebfee4a8dba9a1f40f8feaee6', 'request_id': 'req-85788878-413e-4096-890a-96bccfdbf594'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.328230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c948bd1ebfee4a8dba9a1f40f8feaee6', 'request_id': 'req-85788878-413e-4096-890a-96bccfdbf594'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.335140 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] MFA Rules not processed for user `f882f4fc40fe43f08f9906a406c24411`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:57.336413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:57.337187 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c948bd1ebfee4a8dba9a1f40f8feaee6', 'request_id': 'req-85788878-413e-4096-890a-96bccfdbf594'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.351815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] The token cache is being invalidate because project c948bd1ebfee4a8dba9a1f40f8feaee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:57.352269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.353030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.355090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1374/2728] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:57 2022] DELETE /identity/v3/projects/c948bd1ebfee4a8dba9a1f40f8feaee6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:57.359642 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.361290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:57.444644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1355/2729] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:57.449795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.451312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85788878-413e-4096-890a-96bccfdbf594 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.451627 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:57.456143 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.456822 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.457104 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.457381 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] PATH_INFO: `/v3/users/8b8f4cb0a564444da311158a62b754ed` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.458576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8f4cb0a564444da311158a62b754ed)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.460542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.467004 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d417ffa-8613-413f-8912-949b651fd070 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.472233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.472945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.473226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.473516 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.474240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.476245 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.478195 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:57.512217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1356/2730] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:57 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:43:57.516431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.518621 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8f4cb0a564444da311158a62b754ed'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.529505 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8f4cb0a564444da311158a62b754ed'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.530379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8f4cb0a564444da311158a62b754ed'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.539842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8f4cb0a564444da311158a62b754ed'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.556196 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8f4cb0a564444da311158a62b754ed'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.564177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1375/2731] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:57 2022] DELETE /identity/v3/users/8b8f4cb0a564444da311158a62b754ed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:57.587873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf9afb-1402-40af-968c-d42d530f69e1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.637368 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:57.655265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.655915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.656199 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.656478 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.657143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.659538 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.686032 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1357/2732] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:57 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:57.687782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.689348 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:57.705838 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058a014-7775-4447-a50a-024c0cb0b3b8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.711035 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.711664 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.711940 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.712223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.713038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.715627 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.730741 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1376/2733] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:57.732277 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.746566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c22ff0-b4a9-411e-be2a-b6b5f5a7646d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.752054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.752993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.752993 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.753270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] PATH_INFO: `/v3/projects/0e211e8897cc4445bb0f94acc5cc36e3/users/ecbba807d64b4307a721d1fc72eb7ec4/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.771394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e211e8897cc4445bb0f94acc5cc36e3, user_id=ecbba807d64b4307a721d1fc72eb7ec4, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.774723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.790789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1358/2734] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:57 2022] PUT /identity/v3/projects/0e211e8897cc4445bb0f94acc5cc36e3/users/ecbba807d64b4307a721d1fc72eb7ec4/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:57.795600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.805752 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb584-7360-48d2-b4e2-3af83eb37c2d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.867111 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.867872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.868209 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.868545 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.869500 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.871105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.872458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.872878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:57.887013 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626cf96-46eb-4b81-b67f-1013eeb1d2e2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.890206 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1377/2735] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:57.894486 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.895347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.896288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.896288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.896518 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] PATH_INFO: `/v3/projects/a131910aca024022a6c747b349be1344` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.897626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a131910aca024022a6c747b349be1344)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.899578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.906451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d0e37-ffe4-40c7-80ce-48aaa4a90336 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:57.911386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108613a-898e-4abc-bf8e-03c5febb1f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:57.912136 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108613a-898e-4abc-bf8e-03c5febb1f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.912526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108613a-898e-4abc-bf8e-03c5febb1f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.912891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108613a-898e-4abc-bf8e-03c5febb1f80 admin admin] PATH_INFO: `/v3/projects/0e211e8897cc4445bb0f94acc5cc36e3/users/ecbba807d64b4307a721d1fc72eb7ec4/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.914972 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108613a-898e-4abc-bf8e-03c5febb1f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e211e8897cc4445bb0f94acc5cc36e3, user_id=ecbba807d64b4307a721d1fc72eb7ec4, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:57.917833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108613a-898e-4abc-bf8e-03c5febb1f80 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:57.931259 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1378/2736] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:57 2022] PUT /identity/v3/projects/0e211e8897cc4445bb0f94acc5cc36e3/users/ecbba807d64b4307a721d1fc72eb7ec4/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:57.942427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:57.942722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:57.943120 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:57.947418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a131910aca024022a6c747b349be1344', 'request_id': 'req-8967f76e-3561-4015-9573-9f207944800f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.954402 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a131910aca024022a6c747b349be1344', 'request_id': 'req-8967f76e-3561-4015-9573-9f207944800f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.960430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a131910aca024022a6c747b349be1344', 'request_id': 'req-8967f76e-3561-4015-9573-9f207944800f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.973388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] MFA Rules not processed for user `ecbba807d64b4307a721d1fc72eb7ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:57.974614 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:57.974857 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] The token cache is being invalidate because project a131910aca024022a6c747b349be1344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:57.975190 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.975818 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:57.977922 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1359/2737] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:57 2022] DELETE /identity/v3/projects/a131910aca024022a6c747b349be1344 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:57.981831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:57.983156 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.028163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:58.047926 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967f76e-3561-4015-9573-9f207944800f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:58.050297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1379/2738] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:58.052519 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:58.053189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.053468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.053743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] PATH_INFO: `/v3/users/ad60cefa196e4fb7a74145faa79a2d7d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.055220 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad60cefa196e4fb7a74145faa79a2d7d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:58.057152 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:58.062387 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:58.064316 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.098851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:58.106264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad60cefa196e4fb7a74145faa79a2d7d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.107072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad60cefa196e4fb7a74145faa79a2d7d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.114870 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad60cefa196e4fb7a74145faa79a2d7d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.123124 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad60cefa196e4fb7a74145faa79a2d7d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.123805 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad60cefa196e4fb7a74145faa79a2d7d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.124796 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc902f4-a34c-43d3-9ddd-5ce039a9077d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:58.128767 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf7f1-abec-4a5a-8eaf-6beb71a70dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:58.129384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf7f1-abec-4a5a-8eaf-6beb71a70dba service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.129661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf7f1-abec-4a5a-8eaf-6beb71a70dba service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.129933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf7f1-abec-4a5a-8eaf-6beb71a70dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.131826 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-195cf7f1-abec-4a5a-8eaf-6beb71a70dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.141592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1360/2739] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:57 2022] DELETE /identity/v3/users/ad60cefa196e4fb7a74145faa79a2d7d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:58.144771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf7f1-abec-4a5a-8eaf-6beb71a70dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:58.145730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf7f1-abec-4a5a-8eaf-6beb71a70dba service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:58.156298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1380/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:58.186334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:58.187826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.263991 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814be2-4ca9-4880-b158-d3c0dadc03b6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:58.269355 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:58.270077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.270366 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.270643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] PATH_INFO: `/v3/users/f882f4fc40fe43f08f9906a406c24411` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.271878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f882f4fc40fe43f08f9906a406c24411)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:58.273824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:58.324285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f882f4fc40fe43f08f9906a406c24411'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.325183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f882f4fc40fe43f08f9906a406c24411'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.332345 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f882f4fc40fe43f08f9906a406c24411'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.339747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f882f4fc40fe43f08f9906a406c24411'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.340510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f882f4fc40fe43f08f9906a406c24411'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.358394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1361/2741] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:58 2022] DELETE /identity/v3/users/f882f4fc40fe43f08f9906a406c24411 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:58.362872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839a87-ed3c-4b7d-9426-e21ef200bfae None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.363262 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839a87-ed3c-4b7d-9426-e21ef200bfae None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.363612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839a87-ed3c-4b7d-9426-e21ef200bfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.382552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3e839a87-ed3c-4b7d-9426-e21ef200bfae None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:58.383802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3e839a87-ed3c-4b7d-9426-e21ef200bfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.441568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:58.443710 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.480691 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1381/2742] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:58.482028 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.482321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.482595 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.494102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:58.503299 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] MFA Rules not processed for user `d8c3752f78be48d293440ffbe53af2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:58.504517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.522953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7e2c7-d7c5-4488-94a4-f1f99448cc2a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:58.527839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:58.528483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.528764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.529039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] PATH_INFO: `/v3/projects/23d9fedbb80b459e8d2af80f40e77438` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.530204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d9fedbb80b459e8d2af80f40e77438)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:58.532169 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:58.567431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1382/2743] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:58.567431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:58.567431 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.602737 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d9fedbb80b459e8d2af80f40e77438', 'request_id': 'req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.610877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d9fedbb80b459e8d2af80f40e77438', 'request_id': 'req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.613756 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:58.617361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d9fedbb80b459e8d2af80f40e77438', 'request_id': 'req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.632127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415b053-8130-40e4-b08d-629f7eaed177 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:58.633141 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] The token cache is being invalidate because project 23d9fedbb80b459e8d2af80f40e77438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:58.633435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.634125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.635851 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1362/2744] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:58 2022] DELETE /identity/v3/projects/23d9fedbb80b459e8d2af80f40e77438 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:58.636956 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:58.638305 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.690411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0211b-93a5-458d-90ae-1b173b126204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:58.691064 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0211b-93a5-458d-90ae-1b173b126204 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.691355 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0211b-93a5-458d-90ae-1b173b126204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.691633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0211b-93a5-458d-90ae-1b173b126204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.693743 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-87e0211b-93a5-458d-90ae-1b173b126204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.709364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1f6be-fde7-4abe-a2e1-8f7715c66d17 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:58.714872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:58.715353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.715701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.715982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] PATH_INFO: `/v3/users/b8739e8f195a4441bbbf9189cf3dd4a5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.717193 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8739e8f195a4441bbbf9189cf3dd4a5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:58.719178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:58.772471 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0211b-93a5-458d-90ae-1b173b126204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:58.773930 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0211b-93a5-458d-90ae-1b173b126204 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:58.782092 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8739e8f195a4441bbbf9189cf3dd4a5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.783108 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8739e8f195a4441bbbf9189cf3dd4a5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.785528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1383/2745] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:43:58.786821 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610ef6-9c4f-47e6-8af3-0d7bd085fde0 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.787242 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610ef6-9c4f-47e6-8af3-0d7bd085fde0 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.787576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610ef6-9c4f-47e6-8af3-0d7bd085fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.795621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8739e8f195a4441bbbf9189cf3dd4a5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.804592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8739e8f195a4441bbbf9189cf3dd4a5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.805390 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-576b5679-31d6-4e69-bad1-41cdf10c8686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8739e8f195a4441bbbf9189cf3dd4a5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:58.811354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-74610ef6-9c4f-47e6-8af3-0d7bd085fde0 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:58.812171 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:58.814475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-74610ef6-9c4f-47e6-8af3-0d7bd085fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.824936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1384/2746] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:58.833178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3a68c-6c82-4f19-8ba1-ac359fec1cb8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.833446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3a68c-6c82-4f19-8ba1-ac359fec1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.833726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3a68c-6c82-4f19-8ba1-ac359fec1cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.839154 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1363/2747] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:58 2022] DELETE /identity/v3/users/b8739e8f195a4441bbbf9189cf3dd4a5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:58.843251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.843945 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.844471 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:58.863790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c2c3a68c-6c82-4f19-8ba1-ac359fec1cb8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:58.865413 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c2c3a68c-6c82-4f19-8ba1-ac359fec1cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.866148 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:58.867561 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.956326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1364/2748] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:43:58.965701 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:58.967334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:58.967880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1385/2749] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:58.972114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3a68c-6c82-4f19-8ba1-ac359fec1cb8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:58.984992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3a68c-6c82-4f19-8ba1-ac359fec1cb8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:58.996569 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:58.997235 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:58.997605 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:58.998231 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.001977 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:59.002364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.004170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.030973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1386/2750] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 18:43:59.035117 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.048686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd09c95-0295-4461-8259-643e6c96ef4e admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.055020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.056144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.056437 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.056716 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.057395 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.061203 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.072948 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea7a0-86ac-4f3b-98da-93046c9cab36 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.078688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.079342 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.079627 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.080380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.093466 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.095397 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.103747 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1387/2751] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:43:59 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:59.108995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.111885 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1365/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:43:59.117593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:59.158778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.160400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:59.193129 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270d6d-291f-43a2-a496-53a85a1100e0 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.209701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8116e-b913-4f01-9192-6184e5b1194a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.216534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.218154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.218549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.218848 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.220475 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.223440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.256319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1388/2753] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:43:59 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:43:59.262075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.290528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6500d9-78af-47ea-adb4-c9291f8f928c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.298181 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.298531 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.298970 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.299323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.299660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.299884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.300308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.300743 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] PATH_INFO: `/v3/projects/623a6bf534d84824a9ab4e9b98bcc44d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.301297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.302821 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623a6bf534d84824a9ab4e9b98bcc44d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.303162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.305274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.316561 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1389/2754] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:59.320869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.333995 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11d12f-d579-416b-86ad-b986d1eb9c1d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.340520 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.341389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.341862 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.342205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.343042 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.344882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.356807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:59.362158 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1390/2755] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:43:59.363190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.373745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623a6bf534d84824a9ab4e9b98bcc44d', 'request_id': 'req-677e6c21-574e-4f9e-b6ab-9f01b6090b01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.374754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5e46-aae5-4264-aead-df093becdfe8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.395961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623a6bf534d84824a9ab4e9b98bcc44d', 'request_id': 'req-677e6c21-574e-4f9e-b6ab-9f01b6090b01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.408501 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623a6bf534d84824a9ab4e9b98bcc44d', 'request_id': 'req-677e6c21-574e-4f9e-b6ab-9f01b6090b01'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.425773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] The token cache is being invalidate because project 623a6bf534d84824a9ab4e9b98bcc44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:59.431972 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.434336 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.436329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1366/2756] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:59 2022] DELETE /identity/v3/projects/623a6bf534d84824a9ab4e9b98bcc44d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:43:59.440586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.443637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:59.488225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.488922 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.489265 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.489764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] PATH_INFO: `/v3/projects/09302fbefff54d3491262a7afbe310ed/users/1b19b7d9360a49ab90d5971631305dbd/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.518667 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09302fbefff54d3491262a7afbe310ed, user_id=1b19b7d9360a49ab90d5971631305dbd, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.521560 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.543205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1391/2757] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:43:59 2022] PUT /identity/v3/projects/09302fbefff54d3491262a7afbe310ed/users/1b19b7d9360a49ab90d5971631305dbd/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:59.553094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.553094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:59.553325 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6c21-574e-4f9e-b6ab-9f01b6090b01 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.608833 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:59.623236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.623885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df35e0-e5b2-425c-b0f1-d5982d912e47 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.624030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.624160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.624430 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] PATH_INFO: `/v3/users/ecbba807d64b4307a721d1fc72eb7ec4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.625692 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecbba807d64b4307a721d1fc72eb7ec4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.627696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.629626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.630280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.630607 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.630887 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] PATH_INFO: `/v3/projects/234be4e4eb0a434a9bc6c3d03ac01776` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.632177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=234be4e4eb0a434a9bc6c3d03ac01776)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.634083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.684335 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecbba807d64b4307a721d1fc72eb7ec4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.684990 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecbba807d64b4307a721d1fc72eb7ec4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.688009 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234be4e4eb0a434a9bc6c3d03ac01776', 'request_id': 'req-897ecd00-10af-4187-a2b5-c058484f70e1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.693703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234be4e4eb0a434a9bc6c3d03ac01776', 'request_id': 'req-897ecd00-10af-4187-a2b5-c058484f70e1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.694906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecbba807d64b4307a721d1fc72eb7ec4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.702356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234be4e4eb0a434a9bc6c3d03ac01776', 'request_id': 'req-897ecd00-10af-4187-a2b5-c058484f70e1'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.703316 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecbba807d64b4307a721d1fc72eb7ec4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.704011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7596e93f-4c06-47a0-8b40-da1675ad45cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecbba807d64b4307a721d1fc72eb7ec4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.708869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:59.714868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] The token cache is being invalidate because project 234be4e4eb0a434a9bc6c3d03ac01776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:43:59.715499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.716127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-897ecd00-10af-4187-a2b5-c058484f70e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:43:59.718047 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1392/2758] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:43:59 2022] DELETE /identity/v3/projects/234be4e4eb0a434a9bc6c3d03ac01776 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:59.719464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.719897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.720103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.731696 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1367/2759] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:43:59 2022] DELETE /identity/v3/users/ecbba807d64b4307a721d1fc72eb7ec4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:43:59.732897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2adb01-2a54-4d62-944f-ac02326e9648 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.733489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2adb01-2a54-4d62-944f-ac02326e9648 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.733802 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2adb01-2a54-4d62-944f-ac02326e9648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.754282 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] MFA Rules not processed for user `1b19b7d9360a49ab90d5971631305dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:59.755640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:59.761477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7b2adb01-2a54-4d62-944f-ac02326e9648 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:59.763912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b2adb01-2a54-4d62-944f-ac02326e9648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:59.852440 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1393/2760] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:59.866711 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.869306 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:59.874843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1368/2761] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:59.887492 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d61761-7885-489e-8897-6dd68f4f3549 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.888208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d61761-7885-489e-8897-6dd68f4f3549 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.888709 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d61761-7885-489e-8897-6dd68f4f3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.928963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-13d61761-7885-489e-8897-6dd68f4f3549 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:43:59.930632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13d61761-7885-489e-8897-6dd68f4f3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:43:59.959965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1369/2762] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:43:59.966065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d61761-7885-489e-8897-6dd68f4f3549 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:43:59.977270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d61761-7885-489e-8897-6dd68f4f3549 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.983233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.983869 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.984784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.984784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:43:59.985164 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:43:59.985476 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:43:59.987327 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:43:59.988782 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef92621-17d7-4dbf-9eee-0957ae4b07da None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:43:59.993699 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:43:59.994625 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:43:59.995204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:43:59.996012 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.001839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1370/2763] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:44:00.006133 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.007388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.008928 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.018771 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965121e4-0521-48d6-997d-0458689f2f05 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.024585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1394/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:43:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:00.025946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.027445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.027801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.028153 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.028896 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.031066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.068938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1371/2765] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:44:00 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:44:00.074019 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.085654 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94656d-343e-46a3-9852-ae3b11f56bac service glance] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.103776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:00.123244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.124996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:00.186617 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.187405 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.187951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.188399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.189910 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.192267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.207455 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cca5-0dc8-4680-b1a2-6468240c28e0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.212782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.213429 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.214725 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.215379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] PATH_INFO: `/v3/projects/0e211e8897cc4445bb0f94acc5cc36e3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.216336 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1395/2766] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:44:00 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:00.216800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e211e8897cc4445bb0f94acc5cc36e3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.218724 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.220174 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.237190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632da9-841d-41e3-aeac-66bfaeae266a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.242275 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.243343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.243791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.244040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.244843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.246485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.258989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1396/2767] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:44:00.262241 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.272756 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:00.273983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d92678-f13e-472d-8be9-bd74c8c4e9aa admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.276996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e211e8897cc4445bb0f94acc5cc36e3', 'request_id': 'req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:00.286799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e211e8897cc4445bb0f94acc5cc36e3', 'request_id': 'req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:00.293248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e211e8897cc4445bb0f94acc5cc36e3', 'request_id': 'req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:00.309381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] The token cache is being invalidate because project 0e211e8897cc4445bb0f94acc5cc36e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:44:00.309558 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:00.310362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2774de1e-9e1e-43e5-a0ab-56f793ec5bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:00.311966 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1372/2768] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:44:00 2022] DELETE /identity/v3/projects/0e211e8897cc4445bb0f94acc5cc36e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:44:00.320967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062d84f-2528-4cd0-92b8-075b000fd6fd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.322110 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062d84f-2528-4cd0-92b8-075b000fd6fd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.322788 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062d84f-2528-4cd0-92b8-075b000fd6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.346529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1062d84f-2528-4cd0-92b8-075b000fd6fd None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:00.347795 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1062d84f-2528-4cd0-92b8-075b000fd6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:00.360186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.360842 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.361186 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.361526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.362289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.363997 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.378831 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1397/2769] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:44:00.381555 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.383564 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:00.419985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec4cd-b92e-451d-9892-25ce8a3a9f92 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.434114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd550a-0422-446b-924c-031e1798b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.435706 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd550a-0422-446b-924c-031e1798b35c admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.436000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd550a-0422-446b-924c-031e1798b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.436290 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd550a-0422-446b-924c-031e1798b35c admin admin] PATH_INFO: `/v3/projects/fd4ab73903b54a02bdf17ced6ae0ed5f/users/524a737ec5a249d0ac6e999c35a2e755/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.473526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1373/2770] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:00.484135 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5cee-d7eb-4862-870a-33845dabcf7a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.484617 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5cee-d7eb-4862-870a-33845dabcf7a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.484998 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5cee-d7eb-4862-870a-33845dabcf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.504156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd550a-0422-446b-924c-031e1798b35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4ab73903b54a02bdf17ced6ae0ed5f, user_id=524a737ec5a249d0ac6e999c35a2e755, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.510901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd550a-0422-446b-924c-031e1798b35c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.525470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7b3a5cee-d7eb-4862-870a-33845dabcf7a None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:00.528283 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b3a5cee-d7eb-4862-870a-33845dabcf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:00.542870 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1398/2771] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:00 2022] PUT /identity/v3/projects/fd4ab73903b54a02bdf17ced6ae0ed5f/users/524a737ec5a249d0ac6e999c35a2e755/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:44:00.549132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.549132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.549519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.551401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1374/2772] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:00.553172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5cee-d7eb-4862-870a-33845dabcf7a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.574796 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5cee-d7eb-4862-870a-33845dabcf7a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.580687 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:00.582165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:00.664030 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.664687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.665174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.665619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.666362 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:44:00.666674 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.670011 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.684529 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1399/2773] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:00.694459 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.695532 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1375/2774] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:44:00.696223 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:00.696597 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.709182 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cce8e-7c05-49c0-afd6-60338fdd35db admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.710542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:00.718728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.719824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.720449 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.720734 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.721602 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.724599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.768965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1376/2775] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:44:00 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:00.775093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.810134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849640e1-c15d-44a5-9831-8eefcf3b625d None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.827090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:00.853599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e8e-e47e-43e9-9d31-c421d4d1e267 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.860578 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.861288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.861575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.861843 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.862502 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.864470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.865106 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.865817 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.866169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.866518 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.879936 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.881359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.896649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1377/2776] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:44:00 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:00.901189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.903151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1400/2777] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:00.914023 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95ffcf-63b5-4603-a3fa-a80f48337e5f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.921745 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.922352 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.922787 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.923025 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.923765 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.925486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.940144 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1378/2778] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:00.944816 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:00.959429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582d051-1ba5-46be-8d1b-046ab37e4522 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:00.965713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f0afb-e01d-49b6-993a-3e7150638668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:00.966499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f0afb-e01d-49b6-993a-3e7150638668 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:00.966876 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f0afb-e01d-49b6-993a-3e7150638668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:00.967269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f0afb-e01d-49b6-993a-3e7150638668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:00.968041 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f0afb-e01d-49b6-993a-3e7150638668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:00.969892 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f0afb-e01d-49b6-993a-3e7150638668 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:00.984103 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1401/2779] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:00.988173 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:01.009715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a93e8-e939-4782-8eed-58cfb4440835 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:01.015773 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:01.016854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:01.016854 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:01.017071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] PATH_INFO: `/v3/projects/2a7aac42ba244301861504146315b029/users/85956261443841d98719eb3689d79dcf/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:01.039074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7aac42ba244301861504146315b029, user_id=85956261443841d98719eb3689d79dcf, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:01.044598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:01.068513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1379/2780] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:00 2022] PUT /identity/v3/projects/2a7aac42ba244301861504146315b029/users/85956261443841d98719eb3689d79dcf/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:44:01.074112 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0572-ff52-4da9-9360-ac8523a96983 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:01.074986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0572-ff52-4da9-9360-ac8523a96983 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:01.076828 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0572-ff52-4da9-9360-ac8523a96983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:01.119566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-395f0572-ff52-4da9-9360-ac8523a96983 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:01.122452 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-395f0572-ff52-4da9-9360-ac8523a96983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:01.232360 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1402/2781] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:01.259163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:01.365282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d74d8-f844-4051-9e9a-32bb7a40431b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:01.374764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:01.375195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:01.376189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:01.376736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:01.398418 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:01.400475 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:01.413832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1380/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:03.334399 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1eb6-8f17-4035-9984-2dd63ff5c800 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:03.334973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1eb6-8f17-4035-9984-2dd63ff5c800 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:03.335102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1eb6-8f17-4035-9984-2dd63ff5c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:03.385014 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-245d1eb6-8f17-4035-9984-2dd63ff5c800 None None] MFA Rules not processed for user `85956261443841d98719eb3689d79dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:03.386027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-245d1eb6-8f17-4035-9984-2dd63ff5c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:03.467581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:03.517319 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1403/2783] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:03.522176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:03.533815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39fea-2e6f-4ab7-8b80-3e3bcd4e9e4b service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:03.553017 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:03.553891 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:03.554604 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:03.554793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:03.557102 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:03.560185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:03.610251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1381/2784] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:44:03 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:03.612008 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d1eb6-8f17-4035-9984-2dd63ff5c800 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:03.629502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d1eb6-8f17-4035-9984-2dd63ff5c800 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:03.732478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:03.733333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:03.734825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:03.734825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:03.734825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:03.737102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:03.801600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1404/2785] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:44:03 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:03.806240 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:03.825912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be6bed-debb-487c-8f6e-9c8836d7bda9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:03.830735 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:03.831423 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:03.831702 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:03.831978 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:03.832687 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:03.834351 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:03.856217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1382/2786] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:03.860354 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:03.877444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7283f-358a-4e9d-924f-771e3fe915ad admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:03.886519 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:03.888159 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:03.888540 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:03.889020 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] PATH_INFO: `/v3/projects/ea8cad8d3df3488e8ec0924c1b308aaa/users/294282adb8d54944b6aec6ad1c398cd6/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:03.914672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8cad8d3df3488e8ec0924c1b308aaa, user_id=294282adb8d54944b6aec6ad1c398cd6, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:03.918836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:03.951882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1405/2787] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:03 2022] PUT /identity/v3/projects/ea8cad8d3df3488e8ec0924c1b308aaa/users/294282adb8d54944b6aec6ad1c398cd6/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:03.953212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:03.967988 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b0ada-9578-4164-bf3a-a010c1d85826 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:04.053575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017a7a-a8e6-4f53-9f87-eb4df1999d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:04.054211 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017a7a-a8e6-4f53-9f87-eb4df1999d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:04.054491 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017a7a-a8e6-4f53-9f87-eb4df1999d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:04.054764 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017a7a-a8e6-4f53-9f87-eb4df1999d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:04.055495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017a7a-a8e6-4f53-9f87-eb4df1999d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:04.057183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017a7a-a8e6-4f53-9f87-eb4df1999d3d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:04.063609 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:04.072443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1383/2788] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:04.074051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:04.087185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a447c2-31a3-4a22-8abf-11a1031feeb8 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:04.096660 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df92dc5-efe1-4357-b6ad-4ae8e01da717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:04.111276 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92dc5-efe1-4357-b6ad-4ae8e01da717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:04.111571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92dc5-efe1-4357-b6ad-4ae8e01da717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:04.112998 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92dc5-efe1-4357-b6ad-4ae8e01da717 admin admin] PATH_INFO: `/v3/projects/ea8cad8d3df3488e8ec0924c1b308aaa/users/294282adb8d54944b6aec6ad1c398cd6/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:04.125170 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df92dc5-efe1-4357-b6ad-4ae8e01da717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8cad8d3df3488e8ec0924c1b308aaa, user_id=294282adb8d54944b6aec6ad1c398cd6, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:04.128499 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df92dc5-efe1-4357-b6ad-4ae8e01da717 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:04.164722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1406/2789] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:04 2022] PUT /identity/v3/projects/ea8cad8d3df3488e8ec0924c1b308aaa/users/294282adb8d54944b6aec6ad1c398cd6/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:05.525848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:05.527178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:05.527178 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:05.611744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] MFA Rules not processed for user `294282adb8d54944b6aec6ad1c398cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:05.611744 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:05.712505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1384/2790] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:05.725220 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3ac47-f17e-484a-b4a6-7126df7d425a None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:05.725830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3ac47-f17e-484a-b4a6-7126df7d425a None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:05.725830 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3ac47-f17e-484a-b4a6-7126df7d425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:05.753618 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f6a3ac47-f17e-484a-b4a6-7126df7d425a None None] MFA Rules not processed for user `85956261443841d98719eb3689d79dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:05.754814 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f6a3ac47-f17e-484a-b4a6-7126df7d425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:05.882101 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1407/2791] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:05.889204 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:05.891048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:06.053233 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c6f7-69d9-48c0-bb32-88afce8b16a3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:06.066008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:06.066838 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:06.067174 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:06.067458 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:06.102090 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:06.104708 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:06.125927 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1385/2792] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:07.459736 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4bb5e-049a-4085-a192-0a2a52ed3110 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:07.460620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4bb5e-049a-4085-a192-0a2a52ed3110 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:07.461054 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4bb5e-049a-4085-a192-0a2a52ed3110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:07.510800 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-1ee4bb5e-049a-4085-a192-0a2a52ed3110 None None] MFA Rules not processed for user `524a737ec5a249d0ac6e999c35a2e755`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:07.512200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1ee4bb5e-049a-4085-a192-0a2a52ed3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:07.549218 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:07.594975 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1408/2793] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:07.599688 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:07.674329 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caaa27-7d79-400c-afe2-b4f3c9407aa9 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:07.682341 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:07.683049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:07.683330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:07.683610 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:07.684298 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:07.686234 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:07.703763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:07.718280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1386/2794] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:44:07 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:07.722267 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4bb5e-049a-4085-a192-0a2a52ed3110 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:07.740488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4bb5e-049a-4085-a192-0a2a52ed3110 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:07.847302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:07.848099 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:07.859566 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:07.859855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:07.860585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:07.862612 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:07.903006 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1409/2795] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:44:07 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:07.904799 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:07.916132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22817-f9c2-4008-a0c2-bd58bb7a04bb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:07.922965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:07.924314 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:07.924567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:07.924936 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:07.926093 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:07.928054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:07.942979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1387/2796] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:44:07.944883 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:07.964993 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075172-a463-49d7-b80b-808ddf427cfb admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:07.970867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:07.971754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:07.972444 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:07.972802 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] PATH_INFO: `/v3/projects/b5d5915a664f4b929454df014889d32b/users/9922d8334b5d4574b894f909e290a958/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:07.997302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d5915a664f4b929454df014889d32b, user_id=9922d8334b5d4574b894f909e290a958, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:08.000068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:08.019775 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1410/2797] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:07 2022] PUT /identity/v3/projects/b5d5915a664f4b929454df014889d32b/users/9922d8334b5d4574b894f909e290a958/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:08.023637 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:08.035056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b746f-e5fd-479b-80e1-5c5eaed0a1aa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:08.131887 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b235709-54c5-493e-b365-eb91b1b608fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:08.132644 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235709-54c5-493e-b365-eb91b1b608fb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:08.133033 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235709-54c5-493e-b365-eb91b1b608fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:08.133415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b235709-54c5-493e-b365-eb91b1b608fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:08.134288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b235709-54c5-493e-b365-eb91b1b608fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:08.137071 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b235709-54c5-493e-b365-eb91b1b608fb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:08.156460 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1388/2798] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:08.160435 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:08.174594 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12357699-9f5a-4825-87d6-aaaacbdec8b3 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:08.180432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24af72-8694-41e3-b21a-27a9a789bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:08.181676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24af72-8694-41e3-b21a-27a9a789bfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:08.181676 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24af72-8694-41e3-b21a-27a9a789bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:08.181958 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24af72-8694-41e3-b21a-27a9a789bfa9 admin admin] PATH_INFO: `/v3/projects/b5d5915a664f4b929454df014889d32b/users/9922d8334b5d4574b894f909e290a958/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:08.184208 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24af72-8694-41e3-b21a-27a9a789bfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d5915a664f4b929454df014889d32b, user_id=9922d8334b5d4574b894f909e290a958, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:08.187168 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24af72-8694-41e3-b21a-27a9a789bfa9 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:08.207053 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1411/2799] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:08 2022] PUT /identity/v3/projects/b5d5915a664f4b929454df014889d32b/users/9922d8334b5d4574b894f909e290a958/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:14.533317 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:14.534170 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:14.534607 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:14.574045 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:14.575412 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:14.664385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:14.664844 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:14.664974 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:14.718345 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] MFA Rules not processed for user `9922d8334b5d4574b894f909e290a958`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:14.725438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:14.843204 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1412/2800] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:44:14.859967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:14.864827 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:14.879498 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:14.891798 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1389/2801] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:14.915791 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:14.923443 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:14.953163 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab466-a78d-41da-99af-e12f8f449a72 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:14.956764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34924984-7537-4780-bd40-ebb635ce5390 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f49e424f08d40c5880a8ce3ca1cac59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:14.957447 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924984-7537-4780-bd40-ebb635ce5390 service glance] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:14.957715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924984-7537-4780-bd40-ebb635ce5390 service glance] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:14.957985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924984-7537-4780-bd40-ebb635ce5390 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:15.018826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a695ee-e127-483d-a8ee-e5b03250c01e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:15.025311 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:15.026438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34924984-7537-4780-bd40-ebb635ce5390 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:15.026621 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:15.026871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:15.027217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:15.028343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34924984-7537-4780-bd40-ebb635ce5390 service glance] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:15.037007 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:15.038720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:15.039648 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1413/2802] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:44:15.050723 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1390/2803] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:44:15.191175 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729055-3c22-4a0b-9ef9-16fc5932d145 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:15.191534 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729055-3c22-4a0b-9ef9-16fc5932d145 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:15.191872 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729055-3c22-4a0b-9ef9-16fc5932d145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:15.215967 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-39729055-3c22-4a0b-9ef9-16fc5932d145 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:15.217292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-39729055-3c22-4a0b-9ef9-16fc5932d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:15.282850 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1414/2804] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:44:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:44:15.330632 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:15.332142 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:15.342631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:15.403822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b43577-c408-4143-8744-4005a054f6c3 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:15.411612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:15.412285 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:15.412567 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:15.412872 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:15.425295 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:15.430036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:15.441832 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1391/2805] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:44:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:44:18.105808 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492ac6-779f-4c5b-a9ca-2577e2a77d36 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:18.106394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492ac6-779f-4c5b-a9ca-2577e2a77d36 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:18.106394 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492ac6-779f-4c5b-a9ca-2577e2a77d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:18.132372 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-10492ac6-779f-4c5b-a9ca-2577e2a77d36 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:18.133746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-10492ac6-779f-4c5b-a9ca-2577e2a77d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:18.144526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1415/2806] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:18.169638 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:18.191252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdf12c-aa50-44a7-92a6-7013b28ea2a2 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:18.210215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:18.211127 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:18.211575 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:18.212019 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:18.223736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:18.225565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:18.256902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1392/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:21.170599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:21.171165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:21.171165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:21.199795 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:21.201455 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:21.215583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1416/2808] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:21.271822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:21.294010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2588be-1db1-48b5-9d0b-c6a097b0da58 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:21.303374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:21.304252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:21.304721 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:21.305196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:21.328031 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:21.330043 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:21.342036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1393/2809] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:21.450771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:21.450771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:21.528813 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329af3-267d-4381-9043-fd7520ea2049 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:21.533875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb8654-7ff1-44d7-9d5f-2631458a8c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:21.534453 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb8654-7ff1-44d7-9d5f-2631458a8c6e service cinder] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:21.534735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb8654-7ff1-44d7-9d5f-2631458a8c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:21.535043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb8654-7ff1-44d7-9d5f-2631458a8c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:21.544787 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=100 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:21.611148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb8654-7ff1-44d7-9d5f-2631458a8c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:21.614553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb8654-7ff1-44d7-9d5f-2631458a8c6e service cinder] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:21.626389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1417/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:22.367582 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:22.369307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:22.398297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f912-c371-4142-b60b-bb664aa687ce service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:22.404008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:22.404964 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:22.405522 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:22.406027 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] PATH_INFO: `/v3/users/1b19b7d9360a49ab90d5971631305dbd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:22.407446 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b19b7d9360a49ab90d5971631305dbd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:22.410244 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:22.501147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b19b7d9360a49ab90d5971631305dbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:22.502096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b19b7d9360a49ab90d5971631305dbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:22.515483 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b19b7d9360a49ab90d5971631305dbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:22.528053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b19b7d9360a49ab90d5971631305dbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:22.529136 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b19b7d9360a49ab90d5971631305dbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:22.554054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1394/2811] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:44:22 2022] DELETE /identity/v3/users/1b19b7d9360a49ab90d5971631305dbd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:22.558503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:22.559038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:22.559148 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:22.581502 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:22.583084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:22.658245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1418/2812] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:22.669281 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:22.671118 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:22.798400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:22.814404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3c43f-607e-4cfa-89c2-044cb59f4d1d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:22.819286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326b7a6-4f78-496b-97bf-dbcd8bb45957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:22.819942 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326b7a6-4f78-496b-97bf-dbcd8bb45957 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:22.820195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326b7a6-4f78-496b-97bf-dbcd8bb45957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:22.820465 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326b7a6-4f78-496b-97bf-dbcd8bb45957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:22.833693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326b7a6-4f78-496b-97bf-dbcd8bb45957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:22.835648 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326b7a6-4f78-496b-97bf-dbcd8bb45957 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:22.848694 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1395/2813] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:23.180543 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:23.182343 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:23.223574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceab08-fca9-4327-bf1b-2a85aaa168e3 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:23.231636 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:23.232715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:23.233438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:23.233905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] PATH_INFO: `/v3/projects/09302fbefff54d3491262a7afbe310ed` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:23.235531 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=09302fbefff54d3491262a7afbe310ed)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:23.237875 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:23.309445 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09302fbefff54d3491262a7afbe310ed', 'request_id': 'req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:23.317390 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09302fbefff54d3491262a7afbe310ed', 'request_id': 'req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:23.330790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09302fbefff54d3491262a7afbe310ed', 'request_id': 'req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:23.350656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] The token cache is being invalidate because project 09302fbefff54d3491262a7afbe310ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:44:23.351321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:23.352264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:23.356073 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1419/2814] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:44:23 2022] DELETE /identity/v3/projects/09302fbefff54d3491262a7afbe310ed => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:44:24.364272 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3c6fd-b6eb-40d5-ace4-09e5a216abd1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:24.364817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3c6fd-b6eb-40d5-ace4-09e5a216abd1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:24.364817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3c6fd-b6eb-40d5-ace4-09e5a216abd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:24.387647 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bfb3c6fd-b6eb-40d5-ace4-09e5a216abd1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:24.388898 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bfb3c6fd-b6eb-40d5-ace4-09e5a216abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:24.496367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1396/2815] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:24.514611 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:24.517274 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:24.555924 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:24.612446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a3c64-b9d2-4cc4-8886-4f70e3c7eafd admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:24.621082 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:24.621999 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:24.622280 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:24.622552 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:24.632570 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:24.634182 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:24.648325 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1420/2816] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:25.568728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30395e-1032-4b78-bdc6-7b9408ecbfd6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:25.569284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30395e-1032-4b78-bdc6-7b9408ecbfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:25.569284 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30395e-1032-4b78-bdc6-7b9408ecbfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:25.589486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2b30395e-1032-4b78-bdc6-7b9408ecbfd6 None None] MFA Rules not processed for user `524a737ec5a249d0ac6e999c35a2e755`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:25.590681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2b30395e-1032-4b78-bdc6-7b9408ecbfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:25.643718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1397/2817] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:25.892213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:25.893695 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:25.953900 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce0eca-a3c7-46a5-8e71-40d7ce17968b service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:25.958025 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:25.958667 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:25.958979 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:25.959248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:25.961327 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:25.971745 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:25.973169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:25.982067 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1421/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:27.552816 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ad76-094a-42ec-a24c-7d689e656adb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:27.553318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ad76-094a-42ec-a24c-7d689e656adb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:27.553762 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ad76-094a-42ec-a24c-7d689e656adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:27.578080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f781ad76-094a-42ec-a24c-7d689e656adb None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:27.579900 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f781ad76-094a-42ec-a24c-7d689e656adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:27.590639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1398/2819] 10.222.0.17 () {58 vars in 1016 bytes} [Sun Jul 31 18:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:27.605669 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:27.608568 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:27.609103 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:27.609380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:27.621429 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f3d4e-2649-4902-a692-30b091e7025f service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:27.633698 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:27.635039 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:27.647718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:27.648374 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:27.648655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:27.648933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:27.667456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:27.669060 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:27.688945 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1422/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:27.723280 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1399/2821] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Jul 31 18:44:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:27.745216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:27.746871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:27.837269 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c95aa5-c317-45d0-b65a-8acd3bcb35d7 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:27.842956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:27.844167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:27.844451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:27.844726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:27.853504 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:27.855902 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:27.864871 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1423/2822] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:44:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:44:37.711755 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:37.861722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=85 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:41.661937 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:41.663385 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:41.763587 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9ae38-f08f-4b75-8dcb-ac549a55cf4d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:41.783963 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:41.784619 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:41.784899 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:41.785176 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:41.787112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:41.803599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:41.806036 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:41.820278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1400/2823] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:42.278456 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:42.279962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:42.298835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490089d6-d4fc-47bf-b307-fbcb25a57838 service swift] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:42.303682 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:42.304402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:42.304749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:42.305084 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] PATH_INFO: `/v3/users/85956261443841d98719eb3689d79dcf` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:42.306346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85956261443841d98719eb3689d79dcf)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:42.308571 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:42.357606 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85956261443841d98719eb3689d79dcf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.364890 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85956261443841d98719eb3689d79dcf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.365567 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85956261443841d98719eb3689d79dcf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.375585 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85956261443841d98719eb3689d79dcf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.390205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85956261443841d98719eb3689d79dcf'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.396225 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1424/2824] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:44:42 2022] DELETE /identity/v3/users/85956261443841d98719eb3689d79dcf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:42.611064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:42.624718 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ddc6c-b852-4e57-b22c-3098ed0a630a service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:42.683058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:42.683720 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:42.683995 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:42.684264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] PATH_INFO: `/v3/projects/2a7aac42ba244301861504146315b029` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:42.685398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7aac42ba244301861504146315b029)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:42.687415 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:42.732904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7aac42ba244301861504146315b029', 'request_id': 'req-e9a6ca50-edfe-4778-97d3-d6eb2262fada'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.738890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7aac42ba244301861504146315b029', 'request_id': 'req-e9a6ca50-edfe-4778-97d3-d6eb2262fada'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.744577 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7aac42ba244301861504146315b029', 'request_id': 'req-e9a6ca50-edfe-4778-97d3-d6eb2262fada'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.756163 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] The token cache is being invalidate because project 2a7aac42ba244301861504146315b029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:44:42.756453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.757080 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.758555 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1401/2825] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:44:42 2022] DELETE /identity/v3/projects/2a7aac42ba244301861504146315b029 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:42.763247 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:42.764953 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:42.778086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a553-b910-40b6-bdf8-29fc40902ca1 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:42.837150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:42.838018 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:42.838297 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:42.838580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] PATH_INFO: `/v3/users/294282adb8d54944b6aec6ad1c398cd6` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:42.839881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294282adb8d54944b6aec6ad1c398cd6)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:42.841815 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:42.893245 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294282adb8d54944b6aec6ad1c398cd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.901463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294282adb8d54944b6aec6ad1c398cd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.902362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294282adb8d54944b6aec6ad1c398cd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.914213 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294282adb8d54944b6aec6ad1c398cd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.925396 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:42.933622 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-90fcd91e-c97b-4d4e-a7b8-112eb2c54f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294282adb8d54944b6aec6ad1c398cd6'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:42.947463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1425/2826] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:44:42 2022] DELETE /identity/v3/users/294282adb8d54944b6aec6ad1c398cd6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:43.144221 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:43.146526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:43.163599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ca50-edfe-4778-97d3-d6eb2262fada admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:43.186759 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:43.236020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:43.236669 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.236946 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.237217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] PATH_INFO: `/v3/projects/ea8cad8d3df3488e8ec0924c1b308aaa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.238954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8cad8d3df3488e8ec0924c1b308aaa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:43.241379 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:43.293783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8cad8d3df3488e8ec0924c1b308aaa', 'request_id': 'req-47bab580-a1ba-424e-bf93-a21026815dcc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:43.300686 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8cad8d3df3488e8ec0924c1b308aaa', 'request_id': 'req-47bab580-a1ba-424e-bf93-a21026815dcc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:43.306801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8cad8d3df3488e8ec0924c1b308aaa', 'request_id': 'req-47bab580-a1ba-424e-bf93-a21026815dcc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:43.320435 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] The token cache is being invalidate because project ea8cad8d3df3488e8ec0924c1b308aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:44:43.320716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:43.321356 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-47bab580-a1ba-424e-bf93-a21026815dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:43.323469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1402/2827] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:44:43 2022] DELETE /identity/v3/projects/ea8cad8d3df3488e8ec0924c1b308aaa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:43.329059 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ec52-4004-4168-90d2-e24f962a5b99 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.329556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ec52-4004-4168-90d2-e24f962a5b99 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.329678 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ec52-4004-4168-90d2-e24f962a5b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.355076 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-6683ec52-4004-4168-90d2-e24f962a5b99 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:43.356449 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-6683ec52-4004-4168-90d2-e24f962a5b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:43.421677 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1426/2828] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:43.431374 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b9089-85b6-46e6-a775-5c1206e87a21 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.431901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b9089-85b6-46e6-a775-5c1206e87a21 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.432330 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b9089-85b6-46e6-a775-5c1206e87a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.456663 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8c1b9089-85b6-46e6-a775-5c1206e87a21 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:43.457871 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c1b9089-85b6-46e6-a775-5c1206e87a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:43.467008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1403/2829] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:43.471404 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ec52-4004-4168-90d2-e24f962a5b99 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:43.484055 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ec52-4004-4168-90d2-e24f962a5b99 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:43.490819 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:43.491411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.491690 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.491959 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.492644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:44:43.492976 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:43.495573 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:43.511138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1427/2830] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:44:43.516143 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b9089-85b6-46e6-a775-5c1206e87a21 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:43.526989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b9089-85b6-46e6-a775-5c1206e87a21 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:43.531620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:43.532231 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.532507 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.532777 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.533431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:43.535367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:43.563831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1404/2831] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:44:43 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:43.568226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:43.579476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67988c-3869-48f0-9c5e-501fe4971469 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:43.644583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:43.645210 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.645488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.645757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.646436 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:43.648380 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:43.671867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1428/2832] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:44:43 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:43.675514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:43.691381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471b2e-93b3-4919-9cdf-89d335675b78 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:43.698815 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:43.699470 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.699751 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.700024 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.700719 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:43.702381 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:43.717655 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1405/2833] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:43.721938 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:43.732731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77bcc8-ceaa-40d2-a2cc-fc532ba932c2 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:43.738443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3e66-0077-47b7-aec6-9cac276b663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:43.739226 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3e66-0077-47b7-aec6-9cac276b663d admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.739506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3e66-0077-47b7-aec6-9cac276b663d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.739776 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3e66-0077-47b7-aec6-9cac276b663d admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.740461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c3e66-0077-47b7-aec6-9cac276b663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:43.742127 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c3e66-0077-47b7-aec6-9cac276b663d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:43.754443 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1429/2834] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:43.760461 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:43.771332 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fea1-7f03-476e-92a0-76c396e69b38 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:43.777844 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:43.778511 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.778784 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.779096 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] PATH_INFO: `/v3/projects/241413bbe7a448f492a50450cf8b58f9/users/6b9ff289261846c191f76134109ed562/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.795477 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=241413bbe7a448f492a50450cf8b58f9, user_id=6b9ff289261846c191f76134109ed562, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:43.799216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:43.814251 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1406/2835] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:43 2022] PUT /identity/v3/projects/241413bbe7a448f492a50450cf8b58f9/users/6b9ff289261846c191f76134109ed562/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:43.892929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd42c-97c2-4606-b6ee-39a44d90b133 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:43.893255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd42c-97c2-4606-b6ee-39a44d90b133 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:43.893586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd42c-97c2-4606-b6ee-39a44d90b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:43.922454 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-269dd42c-97c2-4606-b6ee-39a44d90b133 None None] MFA Rules not processed for user `6b9ff289261846c191f76134109ed562`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:43.923722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-269dd42c-97c2-4606-b6ee-39a44d90b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:43.971799 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:43.995211 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1430/2836] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:44.006054 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:44.007839 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:44.063459 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:44.069128 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1516-523e-417c-9712-a33588fec70f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:44.075210 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03508699-734a-488b-9e48-04e7b69f11a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:44.076599 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03508699-734a-488b-9e48-04e7b69f11a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:44.077394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03508699-734a-488b-9e48-04e7b69f11a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:44.077394 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03508699-734a-488b-9e48-04e7b69f11a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:44.086901 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03508699-734a-488b-9e48-04e7b69f11a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:44.088510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03508699-734a-488b-9e48-04e7b69f11a9 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:44.099646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1407/2837] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:44.119939 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd42c-97c2-4606-b6ee-39a44d90b133 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:44.185356 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd42c-97c2-4606-b6ee-39a44d90b133 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:44.190279 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:44.190948 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:44.191237 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:44.191510 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] PATH_INFO: `/v3/users/6b9ff289261846c191f76134109ed562` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:44.192686 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9ff289261846c191f76134109ed562)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:44.194601 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:44.247338 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9ff289261846c191f76134109ed562'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.255386 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9ff289261846c191f76134109ed562'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.256122 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9ff289261846c191f76134109ed562'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.264363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9ff289261846c191f76134109ed562'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.278022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9ff289261846c191f76134109ed562'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.284146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1431/2838] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:44:44 2022] DELETE /identity/v3/users/6b9ff289261846c191f76134109ed562 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:44.288831 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:44.289331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:44.289598 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:44.312008 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:44.313206 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:44.375158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1408/2839] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:44.385029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:44.386432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:44.444929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0987-5994-4492-9922-431b87349605 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:44.449289 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02288a6d-382f-4682-98a4-92c72d306d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:44.449920 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288a6d-382f-4682-98a4-92c72d306d85 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:44.450199 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288a6d-382f-4682-98a4-92c72d306d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:44.450476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288a6d-382f-4682-98a4-92c72d306d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:44.460116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02288a6d-382f-4682-98a4-92c72d306d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:44.461548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02288a6d-382f-4682-98a4-92c72d306d85 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:44.474068 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1432/2840] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:44.754566 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:44.756145 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:44.769057 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d821ea9-2ca7-483a-8d3c-feb263f6dd2f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:44.774623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:44.775915 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:44.776189 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:44.776472 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] PATH_INFO: `/v3/projects/241413bbe7a448f492a50450cf8b58f9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:44.778150 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241413bbe7a448f492a50450cf8b58f9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:44.780256 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:44.827237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241413bbe7a448f492a50450cf8b58f9', 'request_id': 'req-e81b516a-5b22-48cc-9bae-bef3d2c0b699'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.833274 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241413bbe7a448f492a50450cf8b58f9', 'request_id': 'req-e81b516a-5b22-48cc-9bae-bef3d2c0b699'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.839592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241413bbe7a448f492a50450cf8b58f9', 'request_id': 'req-e81b516a-5b22-48cc-9bae-bef3d2c0b699'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.852819 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] The token cache is being invalidate because project 241413bbe7a448f492a50450cf8b58f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:44:44.853676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.854481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e81b516a-5b22-48cc-9bae-bef3d2c0b699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:44.855925 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1409/2841] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:44:44 2022] DELETE /identity/v3/projects/241413bbe7a448f492a50450cf8b58f9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:44.861557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1f9b8-2a94-4bf9-ac8b-432cf5c636e8 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:44.861557 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1f9b8-2a94-4bf9-ac8b-432cf5c636e8 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:44.861846 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1f9b8-2a94-4bf9-ac8b-432cf5c636e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:44.883779 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-91a1f9b8-2a94-4bf9-ac8b-432cf5c636e8 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:44.885705 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-91a1f9b8-2a94-4bf9-ac8b-432cf5c636e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:44.890382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:44.953332 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1433/2842] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:44.960826 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06d1e7-9aea-46cd-9020-8024bda69db2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:44.961125 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06d1e7-9aea-46cd-9020-8024bda69db2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:44.961334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06d1e7-9aea-46cd-9020-8024bda69db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:44.985736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0c06d1e7-9aea-46cd-9020-8024bda69db2 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:44.987055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0c06d1e7-9aea-46cd-9020-8024bda69db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:44.996172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1410/2843] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 18:44:45.000416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1f9b8-2a94-4bf9-ac8b-432cf5c636e8 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:45.010904 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1f9b8-2a94-4bf9-ac8b-432cf5c636e8 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:45.016264 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:45.016891 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.017293 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.017438 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.018134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:44:45.018441 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:45.020093 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:45.033154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1434/2844] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:44:45.037512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06d1e7-9aea-46cd-9020-8024bda69db2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:45.046974 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06d1e7-9aea-46cd-9020-8024bda69db2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:45.051649 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:45.052264 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.052543 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.052817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.053493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:45.055586 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:45.084072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1411/2845] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:44:45 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:45.088384 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:45.098478 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040e85-5921-44a3-9f7b-0be1218bee28 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:45.156807 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:45.157292 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.157568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.157836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.158503 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:45.160461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:45.182467 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1435/2846] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:44:45 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:44:45.187185 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:45.199994 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64e568-faa0-426d-9c09-7981a2702cdd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:45.207074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:45.208198 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.208469 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.208813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.209585 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:45.211534 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:45.223741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1412/2847] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:45.228313 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:45.240312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0809099-3667-44cb-8436-45db5b9ab5fa admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:45.246913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5566c8-b05f-4564-bd6d-c0335e98b030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:45.246913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5566c8-b05f-4564-bd6d-c0335e98b030 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.246913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5566c8-b05f-4564-bd6d-c0335e98b030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.246913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5566c8-b05f-4564-bd6d-c0335e98b030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.248859 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5566c8-b05f-4564-bd6d-c0335e98b030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:45.250526 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5566c8-b05f-4564-bd6d-c0335e98b030 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:45.270860 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1436/2848] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:45.275820 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:45.287321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4dc8-dc17-4568-897a-04179b157d3f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:45.293049 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:45.293825 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.294243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.294596 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] PATH_INFO: `/v3/projects/118c76fcbaea42298b7df5741b4f79e3/users/c791f93b75644fe39574dc4c903042a8/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.313134 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=118c76fcbaea42298b7df5741b4f79e3, user_id=c791f93b75644fe39574dc4c903042a8, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:45.316208 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:45.333062 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1413/2849] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:45 2022] PUT /identity/v3/projects/118c76fcbaea42298b7df5741b4f79e3/users/c791f93b75644fe39574dc4c903042a8/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:45.343532 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7275f-352e-4ddc-b618-26f525d5b9b2 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.343811 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7275f-352e-4ddc-b618-26f525d5b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.344087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7275f-352e-4ddc-b618-26f525d5b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.374062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-67e7275f-352e-4ddc-b618-26f525d5b9b2 None None] MFA Rules not processed for user `c791f93b75644fe39574dc4c903042a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:45.375333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-67e7275f-352e-4ddc-b618-26f525d5b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:45.443901 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1437/2850] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:45.455192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:45.456977 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:45.468089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:45.515380 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec638c-baa0-4263-b0e5-8cbce8643f2b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:45.518884 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329dcd0-20f2-4f90-9b7e-db7a94a65e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:45.519521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329dcd0-20f2-4f90-9b7e-db7a94a65e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:45.519801 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329dcd0-20f2-4f90-9b7e-db7a94a65e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:45.520074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329dcd0-20f2-4f90-9b7e-db7a94a65e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:45.528354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329dcd0-20f2-4f90-9b7e-db7a94a65e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:45.529782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329dcd0-20f2-4f90-9b7e-db7a94a65e7d service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:45.538354 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1414/2851] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:48.607973 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7275f-352e-4ddc-b618-26f525d5b9b2 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:48.613298 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:48.671333 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7275f-352e-4ddc-b618-26f525d5b9b2 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:48.675889 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:48.676528 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:48.676803 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:48.677074 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] PATH_INFO: `/v3/users/c791f93b75644fe39574dc4c903042a8` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:48.678219 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c791f93b75644fe39574dc4c903042a8)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:48.680167 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:48.725070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c791f93b75644fe39574dc4c903042a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:48.732458 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c791f93b75644fe39574dc4c903042a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:48.733102 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c791f93b75644fe39574dc4c903042a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:48.739885 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c791f93b75644fe39574dc4c903042a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:48.752439 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c791f93b75644fe39574dc4c903042a8'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:48.758248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1438/2852] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:44:48 2022] DELETE /identity/v3/users/c791f93b75644fe39574dc4c903042a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:48.762949 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:48.763413 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:48.763576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:48.782252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:48.783468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:48.848943 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1415/2853] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:48.854517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:48.856004 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:48.926950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fae46-604a-422a-8d71-026890d2cb86 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:48.930590 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba5d03-e2ff-428c-8c70-b1c242b994a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:48.931485 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5d03-e2ff-428c-8c70-b1c242b994a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:48.931763 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5d03-e2ff-428c-8c70-b1c242b994a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:48.932038 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5d03-e2ff-428c-8c70-b1c242b994a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:48.941517 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba5d03-e2ff-428c-8c70-b1c242b994a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:48.943016 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba5d03-e2ff-428c-8c70-b1c242b994a0 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:48.956192 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1439/2854] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:49.291348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:49.293451 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:49.309967 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386b0da-46b4-4bf5-8859-77cae0fc421b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:49.316626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:49.319873 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.320162 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.320768 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] PATH_INFO: `/v3/projects/118c76fcbaea42298b7df5741b4f79e3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.322300 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118c76fcbaea42298b7df5741b4f79e3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:49.324879 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:49.383614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118c76fcbaea42298b7df5741b4f79e3', 'request_id': 'req-101d961e-f1c3-468d-ae53-cb5e6b623494'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:49.397513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118c76fcbaea42298b7df5741b4f79e3', 'request_id': 'req-101d961e-f1c3-468d-ae53-cb5e6b623494'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:49.404583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118c76fcbaea42298b7df5741b4f79e3', 'request_id': 'req-101d961e-f1c3-468d-ae53-cb5e6b623494'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:49.421165 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] The token cache is being invalidate because project 118c76fcbaea42298b7df5741b4f79e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:44:49.421463 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:49.422117 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-101d961e-f1c3-468d-ae53-cb5e6b623494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:49.423853 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1416/2855] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:44:49 2022] DELETE /identity/v3/projects/118c76fcbaea42298b7df5741b4f79e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:49.429320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3361-cbf0-45b3-b8e3-f5f0dc4863f6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.429694 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3361-cbf0-45b3-b8e3-f5f0dc4863f6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.430155 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3361-cbf0-45b3-b8e3-f5f0dc4863f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.459030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-731c3361-cbf0-45b3-b8e3-f5f0dc4863f6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:49.461442 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-731c3361-cbf0-45b3-b8e3-f5f0dc4863f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:49.497234 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:49.543402 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1440/2856] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:49.552996 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd8a5b-0216-4694-9654-48ca5db0295e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.553383 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd8a5b-0216-4694-9654-48ca5db0295e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.553592 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd8a5b-0216-4694-9654-48ca5db0295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.573521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-49dd8a5b-0216-4694-9654-48ca5db0295e None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:49.574736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49dd8a5b-0216-4694-9654-48ca5db0295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:49.582814 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1417/2857] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:49.587726 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3361-cbf0-45b3-b8e3-f5f0dc4863f6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:49.597794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3361-cbf0-45b3-b8e3-f5f0dc4863f6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:49.603162 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:49.603933 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.604222 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.604497 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.605185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80136) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:44:49.605489 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:49.607116 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:49.620087 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1441/2858] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:44:49.624147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd8a5b-0216-4694-9654-48ca5db0295e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:49.633512 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd8a5b-0216-4694-9654-48ca5db0295e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:49.638386 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:49.639037 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.639318 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.639913 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.641758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:49.642612 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:49.670808 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1418/2859] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:44:49 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:44:49.675212 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:49.685620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2505711-8cb3-4f2a-93a9-539f690605e5 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:49.745506 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:49.746131 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.746411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.746685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] PATH_INFO: `/v3/users` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.747392 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:49.749323 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:49.773146 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1442/2860] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:44:49 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:44:49.783837 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:49.794506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94105e46-69da-425c-98ee-65d7c7afe9b7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:49.799195 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:49.799810 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.800094 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.800372 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.801065 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:49.802665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:49.803906 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:49.815398 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1419/2861] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:49.819403 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:49.830190 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d19c-2e5e-4210-ab9a-8d6a405ee88c admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:49.834955 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d6647-2292-4a7c-901c-afd4130e8aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:49.835586 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6647-2292-4a7c-901c-afd4130e8aed admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.835867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6647-2292-4a7c-901c-afd4130e8aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.836144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6647-2292-4a7c-901c-afd4130e8aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.836863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6647-2292-4a7c-901c-afd4130e8aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:49.838562 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6647-2292-4a7c-901c-afd4130e8aed admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:49.849052 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1443/2862] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:44:49.853112 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:49.863053 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4895c-039d-4dd9-99b6-0f3cb311773a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:49.867717 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:49.868923 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.869367 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.869651 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] PATH_INFO: `/v3/projects/7c8ca86886544f0593e37fe52c0836c2/users/a54ff91240624ec9be2eb46621b3bda5/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.883741 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8ca86886544f0593e37fe52c0836c2, user_id=a54ff91240624ec9be2eb46621b3bda5, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:49.887263 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:49.900361 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1420/2863] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:44:49 2022] PUT /identity/v3/projects/7c8ca86886544f0593e37fe52c0836c2/users/a54ff91240624ec9be2eb46621b3bda5/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:49.910869 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:49.911194 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:49.911470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:49.939549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] MFA Rules not processed for user `a54ff91240624ec9be2eb46621b3bda5`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:49.940722 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:50.009371 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1444/2864] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:50.020758 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:50.022448 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:50.079105 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e734-93ea-42a0-ab07-f6fe014137c1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:50.082786 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9970bd7f09446339fb291e591cdfbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:50.083437 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:50.083715 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:50.083985 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:50.092800 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:50.094226 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:50.103573 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1421/2865] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:50.813036 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:50.814521 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:50.843176 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:50.875165 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28fa43-7c5d-4feb-a6d1-ee3a193cac3e None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:50.878663 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247cf1-652a-49c8-b274-604877016d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:50.879302 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247cf1-652a-49c8-b274-604877016d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:50.879575 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247cf1-652a-49c8-b274-604877016d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:50.879866 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247cf1-652a-49c8-b274-604877016d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:50.881576 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a6247cf1-652a-49c8-b274-604877016d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:50.944000 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6247cf1-652a-49c8-b274-604877016d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:50.945476 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6247cf1-652a-49c8-b274-604877016d55 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:50.955888 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1445/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:52.726215 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:52.824216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92b332-a24e-44d7-aa7b-0fe8804f76b0 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:52.829940 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:52.830656 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:52.830965 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:52.831320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] PATH_INFO: `/v3/users/a54ff91240624ec9be2eb46621b3bda5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:52.832506 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54ff91240624ec9be2eb46621b3bda5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:52.834521 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:52.919400 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54ff91240624ec9be2eb46621b3bda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:52.920359 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54ff91240624ec9be2eb46621b3bda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:52.932841 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54ff91240624ec9be2eb46621b3bda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:52.941807 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54ff91240624ec9be2eb46621b3bda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:52.942601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54ff91240624ec9be2eb46621b3bda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:52.955258 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:52.970508 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:52.971152 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:52.972599 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:52.975951 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1422/2867] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:44:52 2022] DELETE /identity/v3/users/a54ff91240624ec9be2eb46621b3bda5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:44:52.997546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:44:52.999143 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:53.108249 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1446/2868] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:44:53.115371 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:53.117365 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:53.201912 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e02c1-ea0e-4b4f-a09c-edd1f7b64291 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:53.205803 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:53.206643 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:53.207120 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:53.207401 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:53.217633 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:53.219188 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:53.233605 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1423/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:44:53.570909 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:44:53.572637 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:44:53.590646 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e89c9-fa25-4d77-b567-35a25d285a2c None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:44:53.596045 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:44:53.596427 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:44:53.596801 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:44:53.597169 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] PATH_INFO: `/v3/projects/7c8ca86886544f0593e37fe52c0836c2` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:44:53.598446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8ca86886544f0593e37fe52c0836c2)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:44:53.600553 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:44:53.665628 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8ca86886544f0593e37fe52c0836c2', 'request_id': 'req-05988c77-a0b0-47bd-93ad-1bc0091efeee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:53.672680 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8ca86886544f0593e37fe52c0836c2', 'request_id': 'req-05988c77-a0b0-47bd-93ad-1bc0091efeee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:53.683024 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8ca86886544f0593e37fe52c0836c2', 'request_id': 'req-05988c77-a0b0-47bd-93ad-1bc0091efeee'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:53.685388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:53.700770 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] The token cache is being invalidate because project 7c8ca86886544f0593e37fe52c0836c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:44:53.701062 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:53.701790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:44:53.703853 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1447/2870] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:44:53 2022] DELETE /identity/v3/projects/7c8ca86886544f0593e37fe52c0836c2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:45:03.226229 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:03.699895 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=2 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:04.228877 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:04.230793 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:04.255187 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17631d6-9d22-4f4d-9672-25d33872279e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:04.313824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:04.314468 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:04.314747 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:04.315058 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] PATH_INFO: `/v3/users/d8c3752f78be48d293440ffbe53af2c3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:04.316224 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c3752f78be48d293440ffbe53af2c3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:04.318147 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:04.365214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c3752f78be48d293440ffbe53af2c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.365778 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c3752f78be48d293440ffbe53af2c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.373653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c3752f78be48d293440ffbe53af2c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.380493 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c3752f78be48d293440ffbe53af2c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.381130 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-077f8ab3-74c5-4db2-98d2-5374da50c857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c3752f78be48d293440ffbe53af2c3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.398236 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1424/2871] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:45:04 2022] DELETE /identity/v3/users/d8c3752f78be48d293440ffbe53af2c3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:45:04.574707 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:04.576346 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:04.591698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988c77-a0b0-47bd-93ad-1bc0091efeee admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:04.652100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:04.652644 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:04.652919 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:04.653185 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] PATH_INFO: `/v3/projects/86ef8142407e421b95e9f818da7419ad` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:04.654335 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ef8142407e421b95e9f818da7419ad)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:04.656263 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:04.702255 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ef8142407e421b95e9f818da7419ad', 'request_id': 'req-0648e175-865e-4909-9165-a021dc7c0685'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.707712 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ef8142407e421b95e9f818da7419ad', 'request_id': 'req-0648e175-865e-4909-9165-a021dc7c0685'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.715330 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ef8142407e421b95e9f818da7419ad', 'request_id': 'req-0648e175-865e-4909-9165-a021dc7c0685'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.726464 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] The token cache is being invalidate because project 86ef8142407e421b95e9f818da7419ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:45:04.726746 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.727398 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-0648e175-865e-4909-9165-a021dc7c0685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:45:04.728880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1448/2872] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:45:04 2022] DELETE /identity/v3/projects/86ef8142407e421b95e9f818da7419ad => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:45:04.735846 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d00053-3dff-4e97-9793-280ef66267d1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:04.736175 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d00053-3dff-4e97-9793-280ef66267d1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:04.736457 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d00053-3dff-4e97-9793-280ef66267d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:04.755859 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-20d00053-3dff-4e97-9793-280ef66267d1 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:45:04.757064 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-20d00053-3dff-4e97-9793-280ef66267d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:04.815452 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1425/2873] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:45:04.824339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac08-953a-429a-88a4-b2cc8dfd9cd6 None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:04.824620 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac08-953a-429a-88a4-b2cc8dfd9cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:04.824894 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac08-953a-429a-88a4-b2cc8dfd9cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:04.844905 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-53d8ac08-953a-429a-88a4-b2cc8dfd9cd6 None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:45:04.846094 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-53d8ac08-953a-429a-88a4-b2cc8dfd9cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:04.853937 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1449/2874] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:45:04.858847 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d00053-3dff-4e97-9793-280ef66267d1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:04.868324 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d00053-3dff-4e97-9793-280ef66267d1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:04.873132 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:04.873736 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:04.874013 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:04.874282 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:04.874992 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 18:45:04.875299 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:04.876897 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:04.888497 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1426/2875] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Jul 31 18:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 18:45:04.892978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ac08-953a-429a-88a4-b2cc8dfd9cd6 None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:04.903351 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ac08-953a-429a-88a4-b2cc8dfd9cd6 None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:04.907951 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:04.908558 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:04.908863 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:04.909137 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:04.909794 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:04.911715 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:04.940383 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1450/2876] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:45:04 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:45:04.945192 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:04.956623 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2899c9-1a11-4d35-b7df-8bba9db0e8f8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:04.960160 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:05.015048 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:05.015660 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:05.015939 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:05.016212 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:05.016862 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:05.018776 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:05.040068 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1427/2877] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:45:04 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:45:05.045056 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:05.055361 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e60609-657c-467c-9397-d91095ddcf7a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:05.060857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:05.061468 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:05.061748 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:05.062023 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:05.062719 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:05.064363 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:05.074692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1451/2878] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:45:05.078620 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:05.089246 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5656b9-f91d-4fdc-b8a4-decb7ce1514d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:05.093903 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53588c6-b360-43fe-b037-3e120fcf8d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:05.094509 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53588c6-b360-43fe-b037-3e120fcf8d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:05.094789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53588c6-b360-43fe-b037-3e120fcf8d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:05.095113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53588c6-b360-43fe-b037-3e120fcf8d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:05.095804 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53588c6-b360-43fe-b037-3e120fcf8d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:05.097387 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53588c6-b360-43fe-b037-3e120fcf8d1a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:05.107782 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1428/2879] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:45:05.111858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:05.122150 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ee874-05ad-4037-9f32-ca45bffe228a admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:05.126740 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:05.127432 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:05.127713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:05.127987 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] PATH_INFO: `/v3/projects/4645a540b5dd4c529c0e33212a070417/users/5bf0601d9c304197a32c63a96ae94265/roles/15b0048e55a3471595e2de48b01ecb84` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:05.143417 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4645a540b5dd4c529c0e33212a070417, user_id=5bf0601d9c304197a32c63a96ae94265, role_id=15b0048e55a3471595e2de48b01ecb84)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:05.146040 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:05.160388 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1452/2880] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:45:05 2022] PUT /identity/v3/projects/4645a540b5dd4c529c0e33212a070417/users/5bf0601d9c304197a32c63a96ae94265/roles/15b0048e55a3471595e2de48b01ecb84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:45:05.165252 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24dd6e-46b3-4709-9595-9bc0e01b53cf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:05.165545 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24dd6e-46b3-4709-9595-9bc0e01b53cf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:05.165824 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24dd6e-46b3-4709-9595-9bc0e01b53cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:05.184309 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cf24dd6e-46b3-4709-9595-9bc0e01b53cf None None] MFA Rules not processed for user `6d7a1be1b9784e5783ae48b795a00917`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:45:05.185514 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cf24dd6e-46b3-4709-9595-9bc0e01b53cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:05.247077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1429/2881] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:45:05.256670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:05.258349 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:05.289857 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:05.316825 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9dcc6-8d03-471e-bb2f-8181403480dc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:05.320461 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:05.321129 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:05.321411 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:05.321685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:05.331597 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:05.333029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:05.343358 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1453/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:45:09.351404 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5776f2-ee07-4831-91a9-32c858db3d1f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:09.351979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5776f2-ee07-4831-91a9-32c858db3d1f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:09.351979 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5776f2-ee07-4831-91a9-32c858db3d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:09.383260 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8c5776f2-ee07-4831-91a9-32c858db3d1f None None] MFA Rules not processed for user `5bf0601d9c304197a32c63a96ae94265`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:45:09.384486 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c5776f2-ee07-4831-91a9-32c858db3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:09.459271 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1430/2883] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:45:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:45:09.464416 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:09.475043 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f545d-5f40-4d8a-adfc-f5cc3c5d3b58 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:09.480764 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:09.481544 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:09.481896 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:09.482172 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:09.482855 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:09.484849 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:09.514626 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1454/2884] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Jul 31 18:45:09 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 18:45:09.518287 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5776f2-ee07-4831-91a9-32c858db3d1f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:09.530012 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5776f2-ee07-4831-91a9-32c858db3d1f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:09.543320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:09.593254 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:09.593890 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:09.594307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:09.594583 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:09.595297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:09.597230 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:09.621089 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1431/2885] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Jul 31 18:45:09 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 18:45:09.625154 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:09.636318 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6a5c-8916-41b0-8e94-5b543cb8f2cc admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:09.641366 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:09.641986 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:09.642362 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:09.642542 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:09.643273 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:09.644880 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:09.657230 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1455/2886] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 18:45:09.661453 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:09.671780 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9f1bd-d504-4bc1-ae6e-e47153eb8d2a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:09.676636 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:09.677348 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:09.677631 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:09.678070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] PATH_INFO: `/v3/projects/7f7b036cd68d49b29f7484bd9a3382de/users/16fa3933996342c997406e97c4b8d833/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:09.697346 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7b036cd68d49b29f7484bd9a3382de, user_id=16fa3933996342c997406e97c4b8d833, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:09.701237 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:09.717248 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1432/2887] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:45:09 2022] PUT /identity/v3/projects/7f7b036cd68d49b29f7484bd9a3382de/users/16fa3933996342c997406e97c4b8d833/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:45:09.721002 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:09.732125 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00948c81-dc66-4e6f-b14f-fb507bb69f0f admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:09.792867 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8f493-f02a-4737-9dd3-d97cfd27e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:09.793495 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f493-f02a-4737-9dd3-d97cfd27e3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:09.793851 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f493-f02a-4737-9dd3-d97cfd27e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:09.794031 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f493-f02a-4737-9dd3-d97cfd27e3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:09.794730 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8f493-f02a-4737-9dd3-d97cfd27e3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:09.796347 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8f493-f02a-4737-9dd3-d97cfd27e3cb admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:09.813992 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1456/2888] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Jul 31 18:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 18:45:09.815158 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:09.828529 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9882d-818f-461f-9931-1e022e15ac9c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:09.833548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:09.834223 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:09.834505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:09.834783 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] PATH_INFO: `/v3/projects/7f7b036cd68d49b29f7484bd9a3382de/users/16fa3933996342c997406e97c4b8d833/roles/2f18a54954a047398aca6b1a7389586b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:09.836789 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7b036cd68d49b29f7484bd9a3382de, user_id=16fa3933996342c997406e97c4b8d833, role_id=2f18a54954a047398aca6b1a7389586b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:09.840216 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:09.851548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1433/2889] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Jul 31 18:45:09 2022] PUT /identity/v3/projects/7f7b036cd68d49b29f7484bd9a3382de/users/16fa3933996342c997406e97c4b8d833/roles/2f18a54954a047398aca6b1a7389586b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:45:14.243645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ffc5-a85e-4733-bb21-6f4a01f1391b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:14.244248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ffc5-a85e-4733-bb21-6f4a01f1391b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:14.244248 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ffc5-a85e-4733-bb21-6f4a01f1391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:14.278700 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-c8b8ffc5-a85e-4733-bb21-6f4a01f1391b None None] MFA Rules not processed for user `16fa3933996342c997406e97c4b8d833`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:45:14.280488 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-c8b8ffc5-a85e-4733-bb21-6f4a01f1391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:14.362549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1457/2890] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:45:14.380382 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:14.382347 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:14.466243 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0278b3-b6cc-4611-8446-3c0178ef7ce2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:14.472047 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:14.472676 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:14.472962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:14.473239 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:14.532046 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:14.533653 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:14.544066 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1434/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:45:15.496668 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] REQUEST_METHOD: `POST` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:15.497509 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:15.497783 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:15.517903 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.auth.core [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] MFA Rules not processed for user `5bf0601d9c304197a32c63a96ae94265`. Rule list: `[]` (Enabled: `True`). {{(pid=80136) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:45:15.519134 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:15.526655 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1458/2892] 10.222.0.20 () {58 vars in 958 bytes} [Sun Jul 31 18:45:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:45:24.539214 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:25.512090 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:30.218731 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:30.220307 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:30.278138 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:30.279703 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:30.364614 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39b23e-b969-454f-8741-1b3dc452894d service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:30.370286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:30.370904 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:30.371217 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:30.371494 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:30.373286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:30.374397 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ff67-a495-4ef8-a82d-820e2d869f4b None None] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:30.379474 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:30.380086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:30.380364 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:30.380633 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:30.384954 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:30.386510 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:30.389549 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:30.391132 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:30.396961 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1435/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:45:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:45:30.401792 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1459/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:45:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:45:39.275867 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:39.277331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:39.351456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7163b-e90e-43c2-bf90-513f9af5ee92 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:39.356067 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25080f-dbed-4d24-aa1b-7ab73ffb0d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:39.356699 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25080f-dbed-4d24-aa1b-7ab73ffb0d10 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:39.356975 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25080f-dbed-4d24-aa1b-7ab73ffb0d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:39.357242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25080f-dbed-4d24-aa1b-7ab73ffb0d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:39.365878 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25080f-dbed-4d24-aa1b-7ab73ffb0d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:39.367334 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25080f-dbed-4d24-aa1b-7ab73ffb0d10 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:39.376572 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1436/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:45:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:45:40.396757 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=44 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:40.925656 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:45:40.927385 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:40.974882 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952b8b5-f4c4-436f-9c75-e3303f840e1e service placement] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:45:40.981448 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:45:40.982098 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:45:40.982382 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:45:40.982661 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:45:40.984731 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:45:40.998070 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:45:40.999754 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:45:41.012580 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1460/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:45:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:45:49.372489 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:51.006550 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=18 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:13.007331 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:46:13.007813 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:46:13.007918 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:46:13.038076 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] MFA Rules not processed for user `08b3612fd73644c99e1d8aeb8af68411`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 18:46:13.039302 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:46:13.094444 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1437/2897] 10.222.0.20 () {58 vars in 967 bytes} [Sun Jul 31 18:46:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 18:46:13.136339 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:46:13.137791 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:46:13.212868 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff90b3-aaad-4f71-88ad-0c98074a2e14 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:46:13.217718 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25905fe87291438aa787ecada5cb6865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:46:13.218328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:46:13.218604 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:46:13.218897 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:46:13.226913 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:46:13.229156 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:46:13.237328 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1461/2898] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Jul 31 18:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 18:46:19.795505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:46:19.797072 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:46:19.914550 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2b26-747d-452e-99ef-33cbefbe68d5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:46:19.919242 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:46:19.919907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:46:19.920183 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:46:19.920505 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] PATH_INFO: `/v3/users/524a737ec5a249d0ac6e999c35a2e755` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:46:19.921693 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] RBAC: Authorizing `identity:delete_user(user_id=524a737ec5a249d0ac6e999c35a2e755)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:46:19.923665 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:46:19.970830 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524a737ec5a249d0ac6e999c35a2e755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:19.971513 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524a737ec5a249d0ac6e999c35a2e755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:19.979235 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524a737ec5a249d0ac6e999c35a2e755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:19.986326 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524a737ec5a249d0ac6e999c35a2e755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:19.986989 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524a737ec5a249d0ac6e999c35a2e755'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:19.992056 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:20.005565 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1438/2899] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:46:19 2022] DELETE /identity/v3/users/524a737ec5a249d0ac6e999c35a2e755 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:46:20.181236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:46:20.192446 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5cd2-a842-4f6e-b664-08cbaaf832ab service swift] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:46:20.258790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:46:20.259470 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:46:20.259750 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:46:20.260030 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] PATH_INFO: `/v3/projects/fd4ab73903b54a02bdf17ced6ae0ed5f` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:46:20.261177 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4ab73903b54a02bdf17ced6ae0ed5f)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:46:20.263379 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:46:20.308463 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4ab73903b54a02bdf17ced6ae0ed5f', 'request_id': 'req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.313672 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4ab73903b54a02bdf17ced6ae0ed5f', 'request_id': 'req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.320547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4ab73903b54a02bdf17ced6ae0ed5f', 'request_id': 'req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.332418 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] The token cache is being invalidate because project fd4ab73903b54a02bdf17ced6ae0ed5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:46:20.332701 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.333321 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.334798 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1462/2900] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:46:20 2022] DELETE /identity/v3/projects/fd4ab73903b54a02bdf17ced6ae0ed5f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:46:20.339667 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:46:20.341070 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:46:20.354038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab4384-e964-47bb-a0de-1fa9a346784d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:46:20.408902 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:46:20.409536 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:46:20.409836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:46:20.410106 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] PATH_INFO: `/v3/users/9922d8334b5d4574b894f909e290a958` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:46:20.411278 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9922d8334b5d4574b894f909e290a958)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:46:20.413184 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:46:20.460172 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9922d8334b5d4574b894f909e290a958'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.460910 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9922d8334b5d4574b894f909e290a958'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.468123 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9922d8334b5d4574b894f909e290a958'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.475180 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9922d8334b5d4574b894f909e290a958'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.475817 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9922d8334b5d4574b894f909e290a958'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.492601 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1439/2901] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:46:20 2022] DELETE /identity/v3/users/9922d8334b5d4574b894f909e290a958 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:46:20.667835 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:46:20.669377 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:46:20.682823 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8728c-34d3-4fc9-a21b-c5f2063d4d22 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:46:20.700100 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:20.742310 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:46:20.742984 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:46:20.743451 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:46:20.743881 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] PATH_INFO: `/v3/projects/b5d5915a664f4b929454df014889d32b` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:46:20.745051 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d5915a664f4b929454df014889d32b)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:46:20.746985 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:46:20.794670 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d5915a664f4b929454df014889d32b', 'request_id': 'req-206fe94f-72c7-48fe-80cf-b71801f5b55d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.800240 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d5915a664f4b929454df014889d32b', 'request_id': 'req-206fe94f-72c7-48fe-80cf-b71801f5b55d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.807029 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d5915a664f4b929454df014889d32b', 'request_id': 'req-206fe94f-72c7-48fe-80cf-b71801f5b55d'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.818027 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] The token cache is being invalidate because project b5d5915a664f4b929454df014889d32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80136) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:46:20.818312 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.818956 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:46:20.820546 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1463/2902] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:46:20 2022] DELETE /identity/v3/projects/b5d5915a664f4b929454df014889d32b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:46:30.489084 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=58,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:30.815063 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:47:36.290020 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:47:36.291456 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:36.347938 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8c89a-c6fc-4ec5-a635-f2fcaab56758 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:47:36.401763 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:47:36.402297 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:47:36.402576 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:47:36.402845 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:47:36.404616 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:36.475639 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:47:36.477077 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:47:36.488238 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1440/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:47:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 18:47:37.670641 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:47:37.672095 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:37.685548 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fe94f-72c7-48fe-80cf-b71801f5b55d admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:47:37.689078 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:47:37.689685 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:47:37.689964 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:47:37.690236 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:47:37.691950 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:37.706224 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:47:37.707675 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:47:37.719178 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1464/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:47:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:47:46.483196 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=74 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:47:47.714283 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:47:49.856431 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:47:49.865672 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efed90-ed26-4e2d-8e99-f65f251108f5 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:47:49.869650 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:47:49.870249 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:47:49.870526 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:47:49.870797 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:47:49.872640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:49.882982 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:47:49.884454 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:47:49.893055 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1441/2905] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:47:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:47:49.989228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:47:49.990926 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:50.005556 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200e4b0-8d39-43a5-aebb-2b22ab089a05 service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:47:50.010151 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:47:50.010771 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:47:50.011091 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:47:50.011367 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:47:50.013525 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:50.028217 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:47:50.029643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:47:50.041238 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1465/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:47:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:47:51.170113 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:47:51.179268 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1e9e-c5af-4245-adb3-7d3eb8d7ffb9 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:47:51.182836 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235416b3ebfc42f48be079760f271fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:47:51.183481 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:47:51.183762 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:47:51.184038 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:47:51.185848 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:47:51.196441 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:47:51.197907 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:47:51.206308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1442/2907] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:47:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:48:00.036389 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=6 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:01.202646 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=12 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:49:07.332200 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:49:07.333790 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:49:07.348119 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f927be-1ed0-4082-86b4-832fae18acbe service neutron] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:49:07.353962 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e9920dd81b4f0a8a28a4e8ebef2ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:49:07.354638 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:49:07.354918 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:49:07.355216 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:49:07.357086 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:49:07.370574 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:49:07.372083 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:49:07.384735 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1466/2908] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:49:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:49:12.939495 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:49:12.940962 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:49:13.017707 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1c34-3303-4631-b71e-b980bb9dca84 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:49:13.022659 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:49:13.023267 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:49:13.023544 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:49:13.023811 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:49:13.025564 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:49:13.037320 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:49:13.038908 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:49:13.050714 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1443/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:49:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:49:15.877228 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:49:15.878777 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:49:15.949359 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8f7b-94fb-407e-8e8e-7309971e4912 service nova] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:49:15.954593 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:49:15.955281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:49:15.955565 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:49:15.955836 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] PATH_INFO: `/v3/users/5bf0601d9c304197a32c63a96ae94265` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:49:15.957022 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf0601d9c304197a32c63a96ae94265)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:49:15.958989 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:49:16.011341 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf0601d9c304197a32c63a96ae94265'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.020698 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf0601d9c304197a32c63a96ae94265'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.021421 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf0601d9c304197a32c63a96ae94265'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.032568 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf0601d9c304197a32c63a96ae94265'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.046843 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf0601d9c304197a32c63a96ae94265'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.054978 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1467/2910] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:49:15 2022] DELETE /identity/v3/users/5bf0601d9c304197a32c63a96ae94265 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:49:16.232321 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:49:16.243626 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bbf23-8573-4cbe-9da0-eebea740a0a7 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:49:16.304074 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:49:16.304716 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:49:16.304997 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:49:16.305270 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] PATH_INFO: `/v3/projects/4645a540b5dd4c529c0e33212a070417` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:49:16.306407 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4645a540b5dd4c529c0e33212a070417)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:49:16.308364 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:49:16.354288 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4645a540b5dd4c529c0e33212a070417', 'request_id': 'req-e3e3c225-8246-4a7a-ae28-acee0da3c956'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.360421 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4645a540b5dd4c529c0e33212a070417', 'request_id': 'req-e3e3c225-8246-4a7a-ae28-acee0da3c956'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.365779 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4645a540b5dd4c529c0e33212a070417', 'request_id': 'req-e3e3c225-8246-4a7a-ae28-acee0da3c956'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.378010 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] The token cache is being invalidate because project 4645a540b5dd4c529c0e33212a070417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:49:16.378291 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.378905 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.380640 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1444/2911] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:49:16 2022] DELETE /identity/v3/projects/4645a540b5dd4c529c0e33212a070417 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 18:49:16.384645 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:49:16.386121 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:49:16.400692 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310f94-138c-4b61-80dc-1f2a289fc5b6 admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:49:16.458320 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:49:16.458990 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:49:16.459272 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:49:16.459547 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] PATH_INFO: `/v3/users/16fa3933996342c997406e97c4b8d833` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:49:16.460713 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16fa3933996342c997406e97c4b8d833)` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:49:16.462643 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:49:16.468075 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:49:16.509180 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16fa3933996342c997406e97c4b8d833'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.516205 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16fa3933996342c997406e97c4b8d833'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.516858 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16fa3933996342c997406e97c4b8d833'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.523583 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16fa3933996342c997406e97c4b8d833'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.535581 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.notifications [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16fa3933996342c997406e97c4b8d833'} {{(pid=80136) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.541285 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1468/2912] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Jul 31 18:49:16 2022] DELETE /identity/v3/users/16fa3933996342c997406e97c4b8d833 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:49:16.714014 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:49:16.715462 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:49:16.730044 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3c225-8246-4a7a-ae28-acee0da3c956 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:49:16.747548 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:49:16.790286 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7a1be1b9784e5783ae48b795a00917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ea2a81ace4d57afbbf4c3099ddcb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:49:16.790981 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:49:16.791265 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:49:16.791560 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] PATH_INFO: `/v3/projects/7f7b036cd68d49b29f7484bd9a3382de` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:49:16.792681 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7b036cd68d49b29f7484bd9a3382de)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:49:16.794760 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:49:16.840086 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7b036cd68d49b29f7484bd9a3382de', 'request_id': 'req-6a975622-b9df-440e-9b4e-d3bd3aa90394'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.846308 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7b036cd68d49b29f7484bd9a3382de', 'request_id': 'req-6a975622-b9df-440e-9b4e-d3bd3aa90394'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.851953 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7b036cd68d49b29f7484bd9a3382de', 'request_id': 'req-6a975622-b9df-440e-9b4e-d3bd3aa90394'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.864445 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] The token cache is being invalidate because project 7f7b036cd68d49b29f7484bd9a3382de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 18:49:16.864728 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.865353 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a975622-b9df-440e-9b4e-d3bd3aa90394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 18:49:16.866822 dv-cinder-849846-5-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1445/2913] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Jul 31 18:49:16 2022] DELETE /identity/v3/projects/7f7b036cd68d49b29f7484bd9a3382de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 18:49:26.537929 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:49:26.861523 dv-cinder-849846-5-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:50:36.889658 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Authenticating user token {{(pid=80136) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 18:50:36.891114 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:50:36.959141 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fc1e3-e5eb-4769-aa41-9db1eb9b2b1b admin admin] Validating token access rules against request {{(pid=80136) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 18:50:37.015983 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72952bcb-a9c9-4120-b5bf-4c760445b8e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b07b5471c93462e90c45a195fdc376d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8bbd0dc8c1a4d66ba70cf3e5f6be901', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80136) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 18:50:37.016600 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952bcb-a9c9-4120-b5bf-4c760445b8e9 service placement] REQUEST_METHOD: `GET` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 18:50:37.016874 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952bcb-a9c9-4120-b5bf-4c760445b8e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 18:50:37.017144 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952bcb-a9c9-4120-b5bf-4c760445b8e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80136) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 18:50:37.019281 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.fernet_utils [None req-72952bcb-a9c9-4120-b5bf-4c760445b8e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80136) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 18:50:37.030139 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72952bcb-a9c9-4120-b5bf-4c760445b8e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 18:50:37.031749 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72952bcb-a9c9-4120-b5bf-4c760445b8e9 service placement] RBAC: Authorization granted {{(pid=80136) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 18:50:37.041785 dv-cinder-849846-5-smb devstack@keystone.service[80136]: [pid: 80136|app: 0|req: 1469/2914] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Jul 31 18:50:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 18:50:47.037640 dv-cinder-849846-5-smb devstack@keystone.service[80136]: DEBUG dbcounter [-] [80136] Writing DB stats keystone:SELECT=58 {{(pid=80136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}